-- Logs begin at Thu 2022-07-14 16:19:14 UTC, end at Thu 2022-07-14 17:30:32 UTC. -- Jul 14 17:03:07.338511 dv-osbrick-849858-2-ceph systemd[1]: Starting Devstack devstack@keystone.service... Jul 14 17:03:07.347031 dv-osbrick-849858-2-ceph devstack@keystone.service[98464]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 14 17:03:07.349164 dv-osbrick-849858-2-ceph devstack@keystone.service[98464]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jul 14 17:03:07 2022] *** Jul 14 17:03:07.349164 dv-osbrick-849858-2-ceph devstack@keystone.service[98464]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 14 17:03:07.349164 dv-osbrick-849858-2-ceph devstack@keystone.service[98464]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 14 17:03:07.349164 dv-osbrick-849858-2-ceph devstack@keystone.service[98464]: nodename: dv-osbrick-849858-2-ceph Jul 14 17:03:07.349164 dv-osbrick-849858-2-ceph devstack@keystone.service[98464]: machine: x86_64 Jul 14 17:03:07.349164 dv-osbrick-849858-2-ceph devstack@keystone.service[98464]: clock source: unix Jul 14 17:03:07.349164 dv-osbrick-849858-2-ceph devstack@keystone.service[98464]: pcre jit disabled Jul 14 17:03:07.349164 dv-osbrick-849858-2-ceph devstack@keystone.service[98464]: detected number of CPU cores: 4 Jul 14 17:03:07.349164 dv-osbrick-849858-2-ceph devstack@keystone.service[98464]: current working directory: / Jul 14 17:03:07.349164 dv-osbrick-849858-2-ceph devstack@keystone.service[98464]: detected binary path: /usr/bin/uwsgi-core Jul 14 17:03:07.349164 dv-osbrick-849858-2-ceph devstack@keystone.service[98464]: your processes number limit is 47680 Jul 14 17:03:07.349164 dv-osbrick-849858-2-ceph devstack@keystone.service[98464]: your memory page size is 4096 bytes Jul 14 17:03:07.349164 dv-osbrick-849858-2-ceph devstack@keystone.service[98464]: detected max file descriptor number: 2048 Jul 14 17:03:07.349164 dv-osbrick-849858-2-ceph devstack@keystone.service[98464]: lock engine: pthread robust mutexes Jul 14 17:03:07.350113 dv-osbrick-849858-2-ceph devstack@keystone.service[98464]: thunder lock: enabled Jul 14 17:03:07.350113 dv-osbrick-849858-2-ceph devstack@keystone.service[98464]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 14 17:03:07.350113 dv-osbrick-849858-2-ceph devstack@keystone.service[98464]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 14 17:03:07.398349 dv-osbrick-849858-2-ceph devstack@keystone.service[98464]: Python main interpreter initialized at 0x562eb279b9c0 Jul 14 17:03:07.398349 dv-osbrick-849858-2-ceph devstack@keystone.service[98464]: python threads support enabled Jul 14 17:03:07.398349 dv-osbrick-849858-2-ceph devstack@keystone.service[98464]: your server socket listen backlog is limited to 100 connections Jul 14 17:03:07.398349 dv-osbrick-849858-2-ceph devstack@keystone.service[98464]: your mercy for graceful operations on workers is 90 seconds Jul 14 17:03:07.398694 dv-osbrick-849858-2-ceph devstack@keystone.service[98464]: mapped 403077 bytes (393 KB) for 2 cores Jul 14 17:03:07.398784 dv-osbrick-849858-2-ceph devstack@keystone.service[98464]: *** Operational MODE: preforking *** Jul 14 17:03:07.399153 dv-osbrick-849858-2-ceph devstack@keystone.service[98464]: *** uWSGI is running in multiple interpreter mode *** Jul 14 17:03:07.399153 dv-osbrick-849858-2-ceph devstack@keystone.service[98464]: spawned uWSGI master process (pid: 98464) Jul 14 17:03:07.399302 dv-osbrick-849858-2-ceph systemd[1]: Started Devstack devstack@keystone.service. Jul 14 17:03:07.400337 dv-osbrick-849858-2-ceph devstack@keystone.service[98464]: spawned uWSGI worker 1 (pid: 98474, cores: 1) Jul 14 17:03:07.400337 dv-osbrick-849858-2-ceph devstack@keystone.service[98464]: spawned uWSGI worker 2 (pid: 98475, cores: 1) Jul 14 17:03:07.400337 dv-osbrick-849858-2-ceph devstack@keystone.service[98464]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 14 17:03:13.150788 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 17:03:13.150788 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: from cryptography.utils import int_from_bytes Jul 14 17:03:13.151599 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 17:03:13.151599 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: from cryptography.utils import int_from_bytes Jul 14 17:03:13.199803 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 14 17:03:13.200092 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 14 17:03:13.200292 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] command line args: [] {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 14 17:03:13.200565 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 14 17:03:13.200744 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] ================================================================================ {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 14 17:03:13.200997 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] admin_token = **** {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:03:13.201254 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] config_dir = [] {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:03:13.201443 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:03:13.201656 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] config_source = [] {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:03:13.201839 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] debug = True {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:03:13.202040 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:03:13.203290 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:03:13.203290 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] insecure_debug = False {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:03:13.203290 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:03:13.203290 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:03:13.203290 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] list_limit = None {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:03:13.203583 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] log_config_append = None {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:03:13.203642 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:03:13.203799 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] log_dir = None {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:03:13.203959 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] log_file = None {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:03:13.204193 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:03:13.204443 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:03:13.204691 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:03:13.204939 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:03:13.205118 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:03:13.205298 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:03:13.205567 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:03:13.205814 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:03:13.206126 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:03:13.206303 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:03:13.206525 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:03:13.206735 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:03:13.206984 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:03:13.207232 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] notification_format = cadf {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:03:13.207530 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:03:13.208023 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.136/identity {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:03:13.208231 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] publish_errors = False {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:03:13.208445 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:03:13.208666 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:03:13.208841 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:03:13.209111 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:03:13.209346 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:03:13.209594 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] standard_threads = False {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:03:13.209819 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] strict_password_check = False {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:03:13.210065 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:03:13.210241 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] use_eventlog = False {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:03:13.210834 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] use_journal = False {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:03:13.210834 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] use_json = False {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:03:13.210834 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] use_stderr = False {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:03:13.211005 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] use_syslog = False {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:03:13.211716 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] watch_log_file = False {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:03:13.211959 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.212189 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.212450 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.212688 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.212938 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.213175 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.213423 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.213684 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.213936 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.214184 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.214433 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.214667 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.214914 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.215151 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.215398 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.215646 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.215882 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.216138 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.216392 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.216680 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.216873 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.217126 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.217388 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.217670 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.217929 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.218160 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.218392 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.218623 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.218859 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.219109 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.219355 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.219585 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.219816 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.220063 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.220310 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.220547 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.220795 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.221026 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.221262 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.221496 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.221752 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.221983 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.222214 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.222443 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.222679 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.222928 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.223157 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.223392 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.223621 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.223856 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.224091 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.224351 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.224583 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.224819 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.225054 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.225289 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.225524 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.225788 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.226019 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.226269 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.226504 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.226826 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.226999 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.227265 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.227503 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.227735 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.227975 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.228211 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.228487 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.228726 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.228990 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.229357 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.229466 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.229715 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.229953 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.230202 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] cache.enabled = True {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.230439 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.230674 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.230915 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.231150 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.231387 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.231620 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.231855 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.232089 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.232350 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.232588 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.233092 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.233326 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.233586 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.233827 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.234059 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.234293 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.234524 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.234753 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.234982 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.235216 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.235444 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.235684 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.235918 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.236165 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.236400 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.236655 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.236915 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.237156 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.237385 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] auth.external = None {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.237648 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] auth.mapped = None {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.237955 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.238190 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.238422 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] auth.password = None {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.238654 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] auth.token = None {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.238892 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.239127 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] catalog.caching = True {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.239373 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.239602 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.239849 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.240095 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.240324 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.240558 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] credential.caching = True {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.240805 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] credential.driver = sql {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.241053 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.241299 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.241534 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.241803 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.242037 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.242823 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.243082 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.243319 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.243575 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.243860 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.244107 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.244369 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.244612 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.244869 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.245105 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] federation.caching = True {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.245342 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.245611 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] federation.driver = sql {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.245861 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.246092 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.246339 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.246575 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.246829 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.247066 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.247335 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.247573 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.247824 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.248060 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] identity.caching = True {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.248307 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.248553 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.248788 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.249022 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.249270 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] identity.driver = sql {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.249501 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.249762 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.250012 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.250265 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.250496 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.250727 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.250956 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.251198 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.251445 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.251692 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.251949 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.252208 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.252489 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.252728 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.252966 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.253214 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.253433 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.253686 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.253923 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.254163 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.254403 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.254652 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.254884 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.255132 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.255379 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.255612 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.255857 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.256104 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.256338 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.256576 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.256805 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] ldap.password = **** {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.257042 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.257278 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.257518 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.257781 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.258621 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.258819 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.259070 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.259300 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.259531 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.259782 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.260030 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.260265 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.260498 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.260733 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.260965 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] ldap.user = None {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.261205 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.261465 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.261722 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.261971 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.262218 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.262466 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.262700 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.262930 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.263165 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.263400 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.263635 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.263866 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.264113 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.264359 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.264605 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.264861 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.265106 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.265336 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.265602 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.265841 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.266077 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.266311 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.266546 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.266789 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.267038 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.267275 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.267531 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] policy.driver = sql {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.267768 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.268012 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.268248 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.268484 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] receipt.caching = True {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.268721 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.268969 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.269211 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.269442 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.269701 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.269942 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] resource.caching = True {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.270193 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.270443 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] resource.driver = sql {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.270677 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.270927 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.271176 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.271410 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] revoke.caching = True {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.271657 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.271893 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.272132 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] role.cache_time = None {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.272367 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] role.caching = True {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.272613 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] role.driver = sql {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.272842 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] role.list_limit = None {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.273089 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.273337 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.273690 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.273982 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.274232 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.274482 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.274731 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.274980 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.275212 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.275461 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.275709 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.275956 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.276203 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.276509 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 17:03:13.276509 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: from cryptography.utils import int_from_bytes Jul 14 17:03:13.277016 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.277016 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.277151 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 17:03:13.277151 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: from cryptography.utils import int_from_bytes Jul 14 17:03:13.277273 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.277344 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.277589 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.277845 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.278083 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.278338 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.278591 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.278832 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.279066 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.279299 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.279530 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.279784 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.280042 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.280289 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.280526 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.280762 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.280992 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] token.cache_time = None {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.281228 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] token.caching = True {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.281465 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.281742 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] token.provider = fernet {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.281979 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.282235 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.282483 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.282718 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.282960 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.283202 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.283450 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] trust.driver = sql {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.283685 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.283922 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.284153 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.284400 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.284647 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.284877 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.285118 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.285409 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.285693 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] database.connection = **** {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.285939 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.286187 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.286424 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.286664 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.286899 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.287135 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.287368 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.287609 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.287886 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.288096 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.288337 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.288571 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.288818 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.289051 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.289376 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.289948 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.289948 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.290092 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.290179 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 14 17:03:13.322578 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=98475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 17:03:13.322803 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=98475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 17:03:13.323031 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=98475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 17:03:13.326769 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 14 17:03:13.326974 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 14 17:03:13.327177 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] command line args: [] {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 14 17:03:13.327455 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 14 17:03:13.327640 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] ================================================================================ {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 14 17:03:13.327910 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] admin_token = **** {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:03:13.328165 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] config_dir = [] {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:03:13.328361 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:03:13.328549 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] config_source = [] {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:03:13.328734 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] debug = True {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:03:13.328947 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:03:13.329189 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:03:13.329373 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] insecure_debug = False {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:03:13.329672 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:03:13.329931 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:03:13.330171 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] list_limit = None {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:03:13.330355 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] log_config_append = None {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:03:13.330540 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:03:13.330722 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] log_dir = None {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:03:13.330904 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] log_file = None {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:03:13.331143 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:03:13.331382 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=98475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 17:03:13.331466 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:03:13.331638 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:03:13.331890 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:03:13.332073 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:03:13.332254 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:03:13.332506 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:03:13.332759 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:03:13.333000 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:03:13.333237 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:03:13.333474 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:03:13.333748 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:03:13.334002 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:03:13.334367 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] notification_format = cadf {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:03:13.334665 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:03:13.335181 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.136/identity {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:03:13.335375 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] publish_errors = False {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:03:13.335619 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:03:13.335859 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:03:13.336126 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:03:13.336456 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:03:13.336877 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:03:13.337133 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] standard_threads = False {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:03:13.337381 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] strict_password_check = False {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:03:13.337666 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:03:13.337856 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] use_eventlog = False {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:03:13.338041 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] use_journal = False {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:03:13.338226 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] use_json = False {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:03:13.338411 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] use_stderr = False {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:03:13.338594 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] use_syslog = False {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:03:13.338836 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] watch_log_file = False {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:03:13.339103 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.339352 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.339623 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.339871 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.340132 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.340383 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.340642 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.340888 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.341147 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.341405 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.341691 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.341939 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.342197 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.342444 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.342701 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.342959 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.343203 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.343469 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.343733 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.343988 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.344236 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.344499 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.344770 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.345033 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.345292 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.345532 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.345795 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.346035 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.346280 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.346536 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.346794 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.347032 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.347271 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.347526 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.347784 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.348029 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.348286 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.348525 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.348769 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.349024 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.349263 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.349504 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.349769 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.350009 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.350259 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.350517 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.350758 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.351004 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.351243 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.351483 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.351829 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.352322 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.352595 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.352846 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.353097 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.353345 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.353617 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.353865 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.354105 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.354365 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.354609 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.354856 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.355097 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.355367 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.355613 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.355854 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.356100 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.356347 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.356621 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.356867 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.357126 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.357380 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.357654 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.358168 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.358415 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.358674 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] cache.enabled = True {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.358922 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.359167 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.359420 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=98475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 17:03:13.359504 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.359658 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=98475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 17:03:13.359748 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.359900 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.360150 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.360396 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.360640 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.360911 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.361160 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.361413 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.361689 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.361942 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.362188 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.362435 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.362679 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.362919 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.363160 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.363399 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.363643 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.363882 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.364129 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.364373 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.364630 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.364875 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.365140 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.365410 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.365684 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.365928 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] auth.external = None {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.366167 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] auth.mapped = None {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.366475 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.366718 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.366957 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] auth.password = None {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.367197 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] auth.token = None {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.368340 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.368439 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] catalog.caching = True {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.368699 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.368942 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.369200 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.369458 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.369729 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.369977 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] credential.caching = True {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.370241 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] credential.driver = sql {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.370500 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.370757 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.371003 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.371257 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.371500 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.371774 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.372036 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.372283 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.372546 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.372840 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.373094 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.373365 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.373646 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.373913 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.374158 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] federation.caching = True {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.374402 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.374658 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] federation.driver = sql {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.374914 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.375153 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.375408 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.375652 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.375915 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.376158 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.376422 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.376666 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.376922 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.377167 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] identity.caching = True {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.377424 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.377706 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.377953 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.378200 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.378456 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] identity.driver = sql {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.378696 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.378942 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.379201 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.379461 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.379701 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.379940 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.380185 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.380437 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.380693 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.380948 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.381314 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.381468 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.381773 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.382020 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.382266 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.382503 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.382947 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.383783 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.384210 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.384594 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.384855 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.385120 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.385365 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.385655 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.385919 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.386164 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.386421 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.386680 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.386921 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.387170 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.387409 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] ldap.password = **** {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.387656 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.387901 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.388152 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.388397 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.388644 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.388905 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.389163 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.389402 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.389668 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.389928 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.390190 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.390435 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.390680 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.390925 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.391164 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] ldap.user = None {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.391412 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.391681 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.391922 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.392177 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.392433 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.392688 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.392932 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.393170 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.393412 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.393683 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.393929 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.394167 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.394421 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.394676 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.394931 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.395184 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.395436 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.395673 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.395928 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.396173 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.396416 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.396658 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.396901 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.397154 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.397409 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.397687 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.397952 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] policy.driver = sql {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.398192 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.398445 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.398823 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.399292 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] receipt.caching = True {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.399543 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.399802 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.400058 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.400300 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.400545 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.400835 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] resource.caching = True {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.401055 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.401313 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] resource.driver = sql {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.401583 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.401839 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.402097 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.402340 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] revoke.caching = True {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.402595 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.402837 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.403083 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] role.cache_time = None {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.403327 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] role.caching = True {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.403582 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] role.driver = sql {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.403820 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] role.list_limit = None {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.404074 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.404331 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.404587 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.404843 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.405099 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.405355 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.405647 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.405909 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.406148 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.406406 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.406663 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.406919 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.407174 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.407594 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.407844 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.408107 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.408369 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.408628 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.408888 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.409131 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.409393 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.409691 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.409942 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.410189 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.410430 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.410670 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.410930 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.411196 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.411450 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.411538 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=98475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 17:03:13.411696 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.411941 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.412181 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] token.cache_time = None {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.412427 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] token.caching = True {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.412685 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.412935 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] token.provider = fernet {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.413177 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.413444 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.413731 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.413976 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.414355 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.414816 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.415205 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] trust.driver = sql {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.415460 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.415713 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.415961 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.416222 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.416481 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.416721 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.416974 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.417286 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.417579 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] database.connection = **** {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.417834 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.418093 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.418339 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.418590 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.418835 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.419080 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.419323 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.419565 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.419816 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.420066 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.420317 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.420559 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.420814 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.421057 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.421308 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.421559 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.421818 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.422060 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:03:13.422238 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 14 17:03:13.451177 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=98474) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 17:03:13.451413 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=98474) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 17:03:13.451656 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=98474) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 17:03:13.460234 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=98474) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 17:03:13.462404 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=98475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 17:03:13.462641 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=98475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 17:03:13.479261 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=98474) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 17:03:13.479496 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=98474) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 17:03:13.522879 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=98474) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 17:03:13.527372 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=98475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 17:03:13.527604 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=98475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 17:03:13.527825 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=98475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 17:03:13.528043 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=98475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 17:03:13.528261 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=98475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 17:03:13.528475 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=98475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 17:03:13.551136 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=98475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 17:03:13.551368 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=98475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 17:03:13.551592 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=98475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 17:03:13.551812 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=98475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 17:03:13.552029 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=98475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 17:03:13.552246 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=98475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 17:03:13.552462 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=98475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 17:03:13.559203 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=98474) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 17:03:13.559443 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=98474) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 17:03:13.565774 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=98475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 17:03:13.578328 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=98475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 17:03:13.578558 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=98475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 17:03:13.578779 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=98475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 17:03:13.578997 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=98475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 17:03:13.579214 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=98475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 17:03:13.579435 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=98475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 17:03:13.579649 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=98475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 17:03:13.597161 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=98475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:03:13.597372 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=98475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 14 17:03:13.597739 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=98475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:03:13.597940 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=98475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 14 17:03:13.598209 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=98475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:03:13.598469 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=98475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:03:13.598726 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=98475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:03:13.598978 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=98475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:03:13.604279 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=98474) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 17:03:13.604516 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=98474) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 17:03:13.604745 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=98474) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 17:03:13.604971 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=98474) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 17:03:13.605206 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=98474) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 17:03:13.605429 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=98474) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 17:03:13.610307 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=98475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:03:13.610586 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=98475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:03:13.610852 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=98475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:03:13.611131 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=98475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:03:13.618862 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=98474) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 17:03:13.619095 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=98474) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 17:03:13.619256 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=98475) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 17:03:13.619345 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=98474) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 17:03:13.619538 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=98474) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 17:03:13.619761 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=98474) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 17:03:13.619982 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=98474) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 17:03:13.620199 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=98474) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 17:03:13.622559 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=98475) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 17:03:13.622837 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=98475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:03:13.623115 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=98475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:03:13.623391 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=98475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:03:13.623783 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=98475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:03:13.624042 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=98475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:03:13.624312 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=98475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:03:13.624585 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=98475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:03:13.624853 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=98475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:03:13.625123 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=98475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:03:13.625390 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=98475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:03:13.627913 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=98474) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 17:03:13.631082 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=98474) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 17:03:13.631323 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=98474) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 17:03:13.631555 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=98474) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 17:03:13.631791 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=98474) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 17:03:13.632013 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=98474) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 17:03:13.632232 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=98474) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 17:03:13.632448 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=98474) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 17:03:13.643641 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=98474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:03:13.643855 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=98474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 14 17:03:13.644198 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=98474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:03:13.644405 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=98474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 14 17:03:13.644689 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=98474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:03:13.644972 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=98474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:03:13.645235 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=98474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:03:13.645494 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=98474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:03:13.652608 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=98475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:03:13.654206 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=98475) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 17:03:13.654485 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=98475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:03:13.656928 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=98474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:03:13.657210 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=98474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:03:13.657482 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=98474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:03:13.657897 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=98474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:03:13.659771 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=98475) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 17:03:13.660047 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=98475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:03:13.660326 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=98475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:03:13.667053 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=98474) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 17:03:13.668176 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=98475) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 17:03:13.668455 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=98475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:03:13.670411 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=98474) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 17:03:13.670693 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=98474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:03:13.670990 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=98474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:03:13.671301 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=98474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:03:13.671717 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=98474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:03:13.672023 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=98474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:03:13.672303 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=98474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:03:13.672597 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=98474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:03:13.672876 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=98474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:03:13.673078 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=98475) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 17:03:13.673169 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=98474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:03:13.673366 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=98475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:03:13.673514 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=98474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:03:13.673672 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=98475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:03:13.673953 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=98475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:03:13.674226 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=98475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:03:13.674495 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=98475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:03:13.674759 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=98475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:03:13.675025 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=98475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:03:13.693950 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=98475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:03:13.694227 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=98475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:03:13.699507 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=98475) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 17:03:13.701714 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=98474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:03:13.703198 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=98475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:03:13.703365 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=98474) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 17:03:13.703491 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=98475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:03:13.703653 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=98474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:03:13.708463 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=98475) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 17:03:13.709194 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=98474) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 17:03:13.709484 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=98474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:03:13.709793 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=98474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:03:13.712149 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=98475) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 17:03:13.715922 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=98475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:03:13.716222 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=98475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:03:13.716512 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=98475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:03:13.716794 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=98475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:03:13.717090 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=98475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:03:13.717418 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=98475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:03:13.717529 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=98474) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 17:03:13.717842 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=98474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:03:13.722416 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=98474) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 17:03:13.722706 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=98474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:03:13.722988 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=98474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:03:13.723285 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=98474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:03:13.723562 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=98474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:03:13.723847 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=98474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:03:13.724231 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=98474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:03:13.724514 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=98474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:03:13.737304 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=98475) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 17:03:13.737612 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=98475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:03:13.737971 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=98475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:03:13.738235 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=98475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:03:13.745092 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=98474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:03:13.745371 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=98474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:03:13.746241 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=98475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:03:13.747951 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=98475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:03:13.748229 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=98475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:03:13.750139 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=98474) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 17:03:13.751314 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=98475) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 17:03:13.751591 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=98475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:03:13.751866 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=98475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:03:13.752143 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=98475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:03:13.752441 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=98475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:03:13.753865 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=98474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:03:13.754161 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=98474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:03:13.760005 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=98474) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 17:03:13.763806 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=98474) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 17:03:13.766373 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=98475) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 17:03:13.766650 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=98475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:03:13.766929 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=98475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:03:13.767209 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=98475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:03:13.767497 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=98475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:03:13.767579 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=98474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:03:13.767768 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=98475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:03:13.767851 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=98474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:03:13.768040 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=98475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:03:13.768124 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=98474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:03:13.768341 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=98474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:03:13.768634 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=98474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:03:13.770375 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=98474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:03:13.786215 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=98475) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 17:03:13.790010 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=98475) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 17:03:13.793317 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=98475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:03:13.793869 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=98474) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 17:03:13.794162 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=98474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:03:13.794443 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=98474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:03:13.794710 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=98474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:03:13.795010 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=98475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:03:13.796636 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=98475) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 17:03:13.796913 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=98475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:03:13.797192 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=98475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:03:13.802784 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=98474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:03:13.804525 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=98474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:03:13.804629 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=98475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:03:13.804901 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=98474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:03:13.806456 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=98475) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 17:03:13.808439 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=98474) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 17:03:13.808732 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=98474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:03:13.809015 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=98474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:03:13.809297 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=98474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:03:13.809628 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=98474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:03:13.809715 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=98475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:03:13.810003 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=98475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:03:13.810286 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=98475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:03:13.810566 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=98475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:03:13.821437 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=98475) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 17:03:13.821719 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=98475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:03:13.821992 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=98475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:03:13.824320 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=98474) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 17:03:13.824609 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=98474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:03:13.824895 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=98474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:03:13.825180 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=98474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:03:13.825466 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=98474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:03:13.825842 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=98474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:03:13.826126 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=98474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:03:13.829925 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=98475) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 17:03:13.830205 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=98475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:03:13.830495 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=98475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:03:13.830769 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=98475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:03:13.831053 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=98475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:03:13.831331 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=98475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:03:13.831615 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=98475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:03:13.831882 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=98475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:03:13.832148 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=98475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:03:13.832423 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=98475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:03:13.832700 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=98475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:03:13.832960 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=98475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:03:13.833221 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=98475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:03:13.833486 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=98475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:03:13.845174 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=98474) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 17:03:13.848795 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=98474) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 17:03:13.853165 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=98474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:03:13.854831 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=98474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:03:13.856463 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=98474) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 17:03:13.856748 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=98474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:03:13.857033 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=98474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:03:13.866731 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=98474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:03:13.869640 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=98474) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 17:03:13.873067 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=98474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:03:13.873367 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=98474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:03:13.873463 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x562eb279b9c0 pid: 98475 (default app) Jul 14 17:03:13.873788 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=98474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:03:13.874307 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=98474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:03:13.876910 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df61a9d-2448-42af-b90a-f00f49401366 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:13.877439 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df61a9d-2448-42af-b90a-f00f49401366 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:13.877439 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df61a9d-2448-42af-b90a-f00f49401366 None None] PATH_INFO: `/v3` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:13.885153 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1/1] 10.222.0.136 () {50 vars in 796 bytes} [Thu Jul 14 17:03:13 2022] GET /identity/v3/ => generated 256 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:03:13.885492 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=98474) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 17:03:13.885851 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=98474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:03:13.886729 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=98474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:03:13.900738 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=98474) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 17:03:13.901121 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=98474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:03:13.901427 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=98474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:03:13.901994 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=98474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:03:13.902308 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=98474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:03:13.902592 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=98474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:03:13.903291 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=98474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:03:13.903423 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=98474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:03:13.903685 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=98474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:03:13.904007 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=98474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:03:13.904409 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=98474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:03:13.905344 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=98474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:03:13.905344 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=98474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:03:13.905731 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=98474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:03:13.950194 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x562eb279b9c0 pid: 98474 (default app) Jul 14 17:03:21.925734 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448f66e7-84ec-4958-aeea-3dfff2674f5f None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:21.926285 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448f66e7-84ec-4958-aeea-3dfff2674f5f None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:21.926285 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448f66e7-84ec-4958-aeea-3dfff2674f5f None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:21.927627 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 2/2] 10.222.0.136 () {54 vars in 931 bytes} [Thu Jul 14 17:03:21 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 14 17:03:21.934970 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a69aa9b-4db0-4981-bab4-b87b37b248bf None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:21.935381 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a69aa9b-4db0-4981-bab4-b87b37b248bf None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:21.935547 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a69aa9b-4db0-4981-bab4-b87b37b248bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:22.014112 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: INFO dbcounter [None req-5a69aa9b-4db0-4981-bab4-b87b37b248bf None None] Registered counter for database keystone Jul 14 17:03:22.035487 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG oslo_db.sqlalchemy.engines [None req-5a69aa9b-4db0-4981-bab4-b87b37b248bf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=98474) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 17:03:22.042430 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writer thread running {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 17:03:22.222698 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG passlib.handlers.bcrypt [None req-5a69aa9b-4db0-4981-bab4-b87b37b248bf None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=98474) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 14 17:03:22.223139 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG passlib.handlers.bcrypt [None req-5a69aa9b-4db0-4981-bab4-b87b37b248bf None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=98474) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 14 17:03:22.278651 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-5a69aa9b-4db0-4981-bab4-b87b37b248bf None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:03:22.280282 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-5a69aa9b-4db0-4981-bab4-b87b37b248bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:03:22.406384 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1/3] 10.222.0.136 () {58 vars in 1028 bytes} [Thu Jul 14 17:03:21 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 474 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 14 17:03:22.548063 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448f66e7-84ec-4958-aeea-3dfff2674f5f None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:03:22.624523 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: INFO dbcounter [None req-448f66e7-84ec-4958-aeea-3dfff2674f5f None None] Registered counter for database keystone Jul 14 17:03:22.643674 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG oslo_db.sqlalchemy.engines [None req-448f66e7-84ec-4958-aeea-3dfff2674f5f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=98475) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 17:03:22.650073 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writer thread running {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 17:03:22.769946 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448f66e7-84ec-4958-aeea-3dfff2674f5f None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:03:22.774406 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f2f09f-71a0-4eb5-b8cd-df2e4c755efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '602fa21468b24207a8f98e92cd2c99ce', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:03:22.775075 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f2f09f-71a0-4eb5-b8cd-df2e4c755efa admin admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:22.775364 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f2f09f-71a0-4eb5-b8cd-df2e4c755efa admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:22.775644 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f2f09f-71a0-4eb5-b8cd-df2e4c755efa admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:22.783773 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f2f09f-71a0-4eb5-b8cd-df2e4c755efa admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:03:22.837256 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: WARNING keystone.common.rbac_enforcer.enforcer [None req-96f2f09f-71a0-4eb5-b8cd-df2e4c755efa admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 14 17:03:22.837525 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f2f09f-71a0-4eb5-b8cd-df2e4c755efa admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:03:22.847414 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 3/4] 10.222.0.136 () {58 vars in 1329 bytes} [Thu Jul 14 17:03:22 2022] GET /identity/v3/auth/tokens => generated 915 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 14 17:03:22.853741 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a69aa9b-4db0-4981-bab4-b87b37b248bf None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:03:22.868492 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a69aa9b-4db0-4981-bab4-b87b37b248bf None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:03:22.872952 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb4bd43-54b7-4492-941d-57298b1b51e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '602fa21468b24207a8f98e92cd2c99ce', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:03:22.874097 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb4bd43-54b7-4492-941d-57298b1b51e2 admin admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:22.874389 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb4bd43-54b7-4492-941d-57298b1b51e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:22.874671 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb4bd43-54b7-4492-941d-57298b1b51e2 admin admin] PATH_INFO: `/v3/projects/602fa21468b24207a8f98e92cd2c99ce` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:22.876187 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb4bd43-54b7-4492-941d-57298b1b51e2 admin admin] RBAC: Authorizing `identity:get_project(project_id=602fa21468b24207a8f98e92cd2c99ce)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:03:22.927081 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: WARNING keystone.common.rbac_enforcer.enforcer [None req-3eb4bd43-54b7-4492-941d-57298b1b51e2 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 14 17:03:22.927440 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb4bd43-54b7-4492-941d-57298b1b51e2 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:03:22.932066 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 2/5] 10.222.0.136 () {56 vars in 1212 bytes} [Thu Jul 14 17:03:22 2022] GET /identity/v3/projects/602fa21468b24207a8f98e92cd2c99ce => generated 345 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 17:03:25.198538 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a3e8b6-7ab2-4350-80d7-c95ff1ab8831 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:25.199089 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a3e8b6-7ab2-4350-80d7-c95ff1ab8831 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:25.199089 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a3e8b6-7ab2-4350-80d7-c95ff1ab8831 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:25.203227 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 4/6] 10.222.0.136 () {54 vars in 931 bytes} [Thu Jul 14 17:03:25 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 14 17:03:25.208887 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc253eb-fef6-4a1f-a1bf-24ca8248a2dd None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:25.209327 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc253eb-fef6-4a1f-a1bf-24ca8248a2dd None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:25.209452 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc253eb-fef6-4a1f-a1bf-24ca8248a2dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:25.230520 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-9cc253eb-fef6-4a1f-a1bf-24ca8248a2dd None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:03:25.232044 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-9cc253eb-fef6-4a1f-a1bf-24ca8248a2dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:03:25.240030 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 3/7] 10.222.0.136 () {58 vars in 1028 bytes} [Thu Jul 14 17:03:25 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 14 17:03:25.264896 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a3e8b6-7ab2-4350-80d7-c95ff1ab8831 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:03:25.277249 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a3e8b6-7ab2-4350-80d7-c95ff1ab8831 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:03:25.281456 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b19d14b-beef-441b-aad0-3d955bd62b73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '602fa21468b24207a8f98e92cd2c99ce', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:03:25.282122 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b19d14b-beef-441b-aad0-3d955bd62b73 admin admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:25.282414 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b19d14b-beef-441b-aad0-3d955bd62b73 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:25.282696 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b19d14b-beef-441b-aad0-3d955bd62b73 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:25.291010 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b19d14b-beef-441b-aad0-3d955bd62b73 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:03:25.293036 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b19d14b-beef-441b-aad0-3d955bd62b73 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:03:25.301756 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 5/8] 10.222.0.136 () {58 vars in 1329 bytes} [Thu Jul 14 17:03:25 2022] GET /identity/v3/auth/tokens => generated 915 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 17:03:25.307890 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc253eb-fef6-4a1f-a1bf-24ca8248a2dd None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:03:25.316860 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc253eb-fef6-4a1f-a1bf-24ca8248a2dd None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:03:25.321360 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae400f9-68aa-46fe-87a4-b6d48e0ac3ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '602fa21468b24207a8f98e92cd2c99ce', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:03:25.322246 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae400f9-68aa-46fe-87a4-b6d48e0ac3ca admin admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:25.322532 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae400f9-68aa-46fe-87a4-b6d48e0ac3ca admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:25.322808 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae400f9-68aa-46fe-87a4-b6d48e0ac3ca admin admin] PATH_INFO: `/v3/users/2178b080bea24cb2a1f6b50c1554ccd2` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:25.324188 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae400f9-68aa-46fe-87a4-b6d48e0ac3ca admin admin] RBAC: Authorizing `identity:get_user(user_id=2178b080bea24cb2a1f6b50c1554ccd2)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:03:25.326050 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae400f9-68aa-46fe-87a4-b6d48e0ac3ca admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:03:25.327608 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 4/9] 10.222.0.136 () {56 vars in 1203 bytes} [Thu Jul 14 17:03:25 2022] GET /identity/v3/users/2178b080bea24cb2a1f6b50c1554ccd2 => generated 248 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:03:27.656178 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d396916a-6a98-478b-8b13-6cebd14b58bd None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:27.656697 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d396916a-6a98-478b-8b13-6cebd14b58bd None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:27.656781 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d396916a-6a98-478b-8b13-6cebd14b58bd None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:27.658118 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 6/10] 10.222.0.136 () {54 vars in 931 bytes} [Thu Jul 14 17:03:27 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:03:27.663205 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4003a75-6096-404c-8a5c-37e90c2d6f6f None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:27.664179 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4003a75-6096-404c-8a5c-37e90c2d6f6f None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:27.664708 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4003a75-6096-404c-8a5c-37e90c2d6f6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:27.674766 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09d5554-9fc5-47e0-80bf-cdbe12402143 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:27.675059 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09d5554-9fc5-47e0-80bf-cdbe12402143 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:27.675344 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09d5554-9fc5-47e0-80bf-cdbe12402143 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:27.676683 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 7/11] 10.222.0.136 () {54 vars in 931 bytes} [Thu Jul 14 17:03:27 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 14 17:03:27.682706 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d1aba2-a2b0-40e7-a680-eecb05b026c2 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:27.683001 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d1aba2-a2b0-40e7-a680-eecb05b026c2 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:27.683228 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-f4003a75-6096-404c-8a5c-37e90c2d6f6f None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:03:27.683319 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d1aba2-a2b0-40e7-a680-eecb05b026c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:27.684432 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-f4003a75-6096-404c-8a5c-37e90c2d6f6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:03:27.723787 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG passlib.handlers.bcrypt [None req-a0d1aba2-a2b0-40e7-a680-eecb05b026c2 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=98475) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 14 17:03:27.724218 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG passlib.handlers.bcrypt [None req-a0d1aba2-a2b0-40e7-a680-eecb05b026c2 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=98475) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 14 17:03:27.767230 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 5/12] 10.222.0.136 () {58 vars in 1028 bytes} [Thu Jul 14 17:03:27 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 17:03:27.770427 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-a0d1aba2-a2b0-40e7-a680-eecb05b026c2 None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:03:27.772041 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-a0d1aba2-a2b0-40e7-a680-eecb05b026c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:03:27.792923 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4003a75-6096-404c-8a5c-37e90c2d6f6f None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:03:27.817399 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:03:27.875714 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 8/13] 10.222.0.136 () {58 vars in 1028 bytes} [Thu Jul 14 17:03:27 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 17:03:27.899387 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d1aba2-a2b0-40e7-a680-eecb05b026c2 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:03:27.901241 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4003a75-6096-404c-8a5c-37e90c2d6f6f None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:03:27.934865 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd88d1c-3f2f-48fa-873b-a24ba115d104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:03:27.935687 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd88d1c-3f2f-48fa-873b-a24ba115d104 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:27.935974 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd88d1c-3f2f-48fa-873b-a24ba115d104 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:27.936250 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd88d1c-3f2f-48fa-873b-a24ba115d104 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:27.948217 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd88d1c-3f2f-48fa-873b-a24ba115d104 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 17:03:27.959524 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-3bd88d1c-3f2f-48fa-873b-a24ba115d104 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 17:03:27.959524 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:03:27.959524 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:03:27.959524 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:03:27.959524 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:03:27.959524 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:03:27.959524 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:03:27.959524 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:03:27.959524 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:03:27.959524 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:03:27.959524 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:03:27.959524 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:03:27.959524 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 17:03:27.959524 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 17:03:27.959524 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 17:03:27.959524 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 17:03:27.961315 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 17:03:27.961315 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 17:03:27.961315 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 17:03:27.961315 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 17:03:27.961315 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:03:27.961315 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:03:27.961315 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:03:27.961315 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:03:27.961315 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:03:27.961315 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:03:27.961315 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:03:27.961315 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Jul 14 17:03:27.961315 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:03:27.961315 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:03:27.961315 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:03:27.961315 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:03:27.962258 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:03:27.962258 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:03:27.962258 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:03:27.962258 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:03:27.962258 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 17:03:27.962258 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 17:03:27.962258 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 17:03:27.962258 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 17:03:27.962258 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 17:03:27.962258 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 17:03:27.962258 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 17:03:27.962258 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Jul 14 17:03:27.962258 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 6/14] 10.222.0.136 () {56 vars in 1101 bytes} [Thu Jul 14 17:03:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 17:03:27.967304 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd88d1c-3f2f-48fa-873b-a24ba115d104 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:03:28.002451 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d1aba2-a2b0-40e7-a680-eecb05b026c2 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:03:28.004741 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:03:28.041261 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828053b2-2a21-42bb-ae77-f1b643cf4281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:03:28.042191 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828053b2-2a21-42bb-ae77-f1b643cf4281 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:28.042485 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828053b2-2a21-42bb-ae77-f1b643cf4281 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:28.042771 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828053b2-2a21-42bb-ae77-f1b643cf4281 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:28.049315 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:03:28.073819 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd88d1c-3f2f-48fa-873b-a24ba115d104 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:03:28.108718 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45c8d6f-ddab-4aee-82f6-d5f5e5b2216a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:03:28.109392 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45c8d6f-ddab-4aee-82f6-d5f5e5b2216a None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:28.109721 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45c8d6f-ddab-4aee-82f6-d5f5e5b2216a None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:28.110003 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45c8d6f-ddab-4aee-82f6-d5f5e5b2216a None admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:28.110760 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45c8d6f-ddab-4aee-82f6-d5f5e5b2216a None admin] RBAC: Adding query filter params (name=admin) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:03:28.111071 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45c8d6f-ddab-4aee-82f6-d5f5e5b2216a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:03:28.112471 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45c8d6f-ddab-4aee-82f6-d5f5e5b2216a None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:03:28.113854 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828053b2-2a21-42bb-ae77-f1b643cf4281 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:03:28.115341 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828053b2-2a21-42bb-ae77-f1b643cf4281 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:03:28.124968 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 7/15] 10.222.0.136 () {56 vars in 1104 bytes} [Thu Jul 14 17:03:27 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 17:03:28.130724 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45c8d6f-ddab-4aee-82f6-d5f5e5b2216a None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:03:28.220202 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 9/16] 10.222.0.136 () {58 vars in 1287 bytes} [Thu Jul 14 17:03:27 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 14 17:03:28.226918 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828053b2-2a21-42bb-ae77-f1b643cf4281 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:03:28.231372 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:03:28.339449 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828053b2-2a21-42bb-ae77-f1b643cf4281 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:03:28.347929 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45c8d6f-ddab-4aee-82f6-d5f5e5b2216a None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:03:28.375511 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4f9029-a056-4ddf-871b-7e605ec08e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:03:28.376304 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4f9029-a056-4ddf-871b-7e605ec08e7d None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:28.376586 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4f9029-a056-4ddf-871b-7e605ec08e7d None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:28.376862 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4f9029-a056-4ddf-871b-7e605ec08e7d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:28.383198 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e529ed-8fdf-4de5-8ba6-20bb329c4a53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:03:28.384071 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e529ed-8fdf-4de5-8ba6-20bb329c4a53 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:28.384361 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e529ed-8fdf-4de5-8ba6-20bb329c4a53 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:28.384641 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e529ed-8fdf-4de5-8ba6-20bb329c4a53 None admin] PATH_INFO: `/v3/users/2178b080bea24cb2a1f6b50c1554ccd2` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:28.385897 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e529ed-8fdf-4de5-8ba6-20bb329c4a53 None admin] RBAC: Authorizing `identity:get_user(user_id=2178b080bea24cb2a1f6b50c1554ccd2)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:03:28.387371 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e529ed-8fdf-4de5-8ba6-20bb329c4a53 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:03:28.388995 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 8/17] 10.222.0.136 () {56 vars in 1182 bytes} [Thu Jul 14 17:03:28 2022] GET /identity/v3/users/2178b080bea24cb2a1f6b50c1554ccd2 => generated 248 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 17:03:28.394469 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e529ed-8fdf-4de5-8ba6-20bb329c4a53 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:03:28.395859 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4f9029-a056-4ddf-871b-7e605ec08e7d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:03:28.397357 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4f9029-a056-4ddf-871b-7e605ec08e7d None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:03:28.409385 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:03:28.420758 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-7e4f9029-a056-4ddf-871b-7e605ec08e7d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:03:28.420758 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:03:28.420758 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:03:28.420758 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:03:28.420758 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:03:28.420758 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:03:28.420758 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:03:28.420758 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:03:28.420758 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:03:28.420758 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:03:28.420758 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:03:28.420758 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:03:28.420758 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 17:03:28.420758 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 17:03:28.420758 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 17:03:28.421615 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 17:03:28.421615 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:03:28.421615 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:03:28.421615 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:03:28.421615 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:03:28.421615 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:03:28.421615 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:03:28.421615 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:03:28.421615 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Jul 14 17:03:28.421615 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:03:28.421615 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:03:28.421615 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:03:28.421615 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:03:28.421615 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:03:28.421615 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:03:28.421615 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:03:28.421615 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:03:28.422689 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 17:03:28.422689 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 17:03:28.422689 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:03:28.422689 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Jul 14 17:03:28.422689 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 10/18] 10.222.0.136 () {56 vars in 1113 bytes} [Thu Jul 14 17:03:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 17:03:28.427843 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4f9029-a056-4ddf-871b-7e605ec08e7d None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:03:28.505533 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e529ed-8fdf-4de5-8ba6-20bb329c4a53 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:03:28.544435 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76f6b5a-4103-4191-afbf-8c4e11eb3ea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:03:28.545248 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76f6b5a-4103-4191-afbf-8c4e11eb3ea0 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:28.545582 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76f6b5a-4103-4191-afbf-8c4e11eb3ea0 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:28.545855 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76f6b5a-4103-4191-afbf-8c4e11eb3ea0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:28.547076 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76f6b5a-4103-4191-afbf-8c4e11eb3ea0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:03:28.548554 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76f6b5a-4103-4191-afbf-8c4e11eb3ea0 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:03:28.550328 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 9/19] 10.222.0.136 () {56 vars in 1113 bytes} [Thu Jul 14 17:03:28 2022] GET /identity/v3/domains/default => generated 200 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 17:03:28.558035 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76f6b5a-4103-4191-afbf-8c4e11eb3ea0 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:03:28.593935 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:03:28.637888 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4f9029-a056-4ddf-871b-7e605ec08e7d None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:03:28.639749 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:03:28.659383 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76f6b5a-4103-4191-afbf-8c4e11eb3ea0 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:03:28.672011 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58c1927-90b5-43b9-b16c-3531b23a5b7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:03:28.672677 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58c1927-90b5-43b9-b16c-3531b23a5b7c None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:28.672962 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58c1927-90b5-43b9-b16c-3531b23a5b7c None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:28.673241 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58c1927-90b5-43b9-b16c-3531b23a5b7c None admin] PATH_INFO: `/v3/domains` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:28.673997 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58c1927-90b5-43b9-b16c-3531b23a5b7c None admin] RBAC: Adding query filter params (name=Default) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:03:28.674309 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58c1927-90b5-43b9-b16c-3531b23a5b7c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:03:28.675680 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58c1927-90b5-43b9-b16c-3531b23a5b7c None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:03:28.692568 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 11/20] 10.222.0.136 () {56 vars in 1114 bytes} [Thu Jul 14 17:03:28 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 17:03:28.692824 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aac678-9570-4dc6-b9aa-81b1a6ee0024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:03:28.693475 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aac678-9570-4dc6-b9aa-81b1a6ee0024 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:28.693797 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aac678-9570-4dc6-b9aa-81b1a6ee0024 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:28.694078 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aac678-9570-4dc6-b9aa-81b1a6ee0024 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:28.694921 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49aac678-9570-4dc6-b9aa-81b1a6ee0024 None admin] RBAC: Adding query filter params (role.id=284c6314b4d3492085e397a87b0e3b51, scope.domain.id=default, user.id=2178b080bea24cb2a1f6b50c1554ccd2) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:03:28.695241 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49aac678-9570-4dc6-b9aa-81b1a6ee0024 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:03:28.696730 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49aac678-9570-4dc6-b9aa-81b1a6ee0024 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:03:28.704381 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 10/21] 10.222.0.136 () {56 vars in 1327 bytes} [Thu Jul 14 17:03:28 2022] GET /identity/v3/role_assignments?user.id=2178b080bea24cb2a1f6b50c1554ccd2&scope.domain.id=default&role.id=284c6314b4d3492085e397a87b0e3b51 => generated 234 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:03:31.170033 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecd7c7c-b020-4ae3-9d74-7c08d8dbe619 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:31.170549 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecd7c7c-b020-4ae3-9d74-7c08d8dbe619 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:31.170654 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecd7c7c-b020-4ae3-9d74-7c08d8dbe619 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:31.171962 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 12/22] 10.222.0.136 () {54 vars in 931 bytes} [Thu Jul 14 17:03:31 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:03:31.177245 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fcfb97-765d-4b5a-a9a5-af5364522341 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:31.177669 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fcfb97-765d-4b5a-a9a5-af5364522341 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:31.177835 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fcfb97-765d-4b5a-a9a5-af5364522341 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:31.209740 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-17fcfb97-765d-4b5a-a9a5-af5364522341 None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:03:31.212107 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-17fcfb97-765d-4b5a-a9a5-af5364522341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:03:31.307332 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 11/23] 10.222.0.136 () {58 vars in 1028 bytes} [Thu Jul 14 17:03:31 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 17:03:31.348766 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecd7c7c-b020-4ae3-9d74-7c08d8dbe619 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:03:31.488681 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecd7c7c-b020-4ae3-9d74-7c08d8dbe619 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:03:31.516048 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:03:31.529285 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23e0734-43c4-429b-8f40-0e21c2b9352f None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:31.529642 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23e0734-43c4-429b-8f40-0e21c2b9352f None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:31.529895 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23e0734-43c4-429b-8f40-0e21c2b9352f None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:31.531446 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 12/24] 10.222.0.136 () {54 vars in 931 bytes} [Thu Jul 14 17:03:31 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 14 17:03:31.542671 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ee10ec-35c4-491c-ab62-3953f694b525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:03:31.543781 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ee10ec-35c4-491c-ab62-3953f694b525 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:31.545041 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f91551d-a9ad-454e-8623-abd7537695a5 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:31.545329 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f91551d-a9ad-454e-8623-abd7537695a5 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:31.545635 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f91551d-a9ad-454e-8623-abd7537695a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:31.547391 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ee10ec-35c4-491c-ab62-3953f694b525 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:31.550730 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ee10ec-35c4-491c-ab62-3953f694b525 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:31.570428 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-1f91551d-a9ad-454e-8623-abd7537695a5 None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:03:31.571652 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-1f91551d-a9ad-454e-8623-abd7537695a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:03:31.576891 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ee10ec-35c4-491c-ab62-3953f694b525 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:03:31.578411 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ee10ec-35c4-491c-ab62-3953f694b525 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:03:31.610350 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-35ee10ec-35c4-491c-ab62-3953f694b525 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:03:31.610350 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:03:31.610350 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:03:31.610350 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:03:31.610350 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:03:31.610350 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:03:31.610350 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:03:31.610350 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:03:31.610350 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:03:31.610350 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:03:31.610350 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:03:31.610350 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:03:31.610350 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 17:03:31.610350 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 17:03:31.610350 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 17:03:31.611224 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 17:03:31.611224 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:03:31.611224 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:03:31.611224 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:03:31.611224 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:03:31.611224 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:03:31.611224 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:03:31.611224 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:03:31.611224 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Jul 14 17:03:31.611224 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:03:31.611224 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:03:31.611224 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:03:31.611224 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:03:31.611224 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:03:31.611224 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:03:31.611224 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:03:31.611224 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:03:31.612479 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 17:03:31.612479 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 17:03:31.612479 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:03:31.612479 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Jul 14 17:03:31.612479 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 13/25] 10.222.0.136 () {56 vars in 1113 bytes} [Thu Jul 14 17:03:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:03:31.620985 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ee10ec-35c4-491c-ab62-3953f694b525 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:03:31.701569 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 13/26] 10.222.0.136 () {58 vars in 1028 bytes} [Thu Jul 14 17:03:31 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 17:03:31.759542 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ee10ec-35c4-491c-ab62-3953f694b525 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:03:31.767989 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f91551d-a9ad-454e-8623-abd7537695a5 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:03:31.774080 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:03:31.809268 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80052937-0d84-4baf-a021-07291fe4f72c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:03:31.809977 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80052937-0d84-4baf-a021-07291fe4f72c None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:31.810266 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80052937-0d84-4baf-a021-07291fe4f72c None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:31.810546 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80052937-0d84-4baf-a021-07291fe4f72c None admin] PATH_INFO: `/v3/domains` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:31.811287 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80052937-0d84-4baf-a021-07291fe4f72c None admin] RBAC: Adding query filter params (name=Default) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:03:31.811596 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80052937-0d84-4baf-a021-07291fe4f72c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:03:31.812985 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80052937-0d84-4baf-a021-07291fe4f72c None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:03:31.836585 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 14/27] 10.222.0.136 () {56 vars in 1114 bytes} [Thu Jul 14 17:03:31 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:03:31.842271 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80052937-0d84-4baf-a021-07291fe4f72c None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:03:31.907678 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:03:31.991901 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f91551d-a9ad-454e-8623-abd7537695a5 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:03:32.042980 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80052937-0d84-4baf-a021-07291fe4f72c None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:03:32.063924 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e8f546-73a9-48fe-ba53-aed7c46a55a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:03:32.064743 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e8f546-73a9-48fe-ba53-aed7c46a55a9 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:32.065031 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e8f546-73a9-48fe-ba53-aed7c46a55a9 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:32.065310 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e8f546-73a9-48fe-ba53-aed7c46a55a9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:32.098322 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e8f546-73a9-48fe-ba53-aed7c46a55a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 17:03:32.105166 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71e3fb1-1ee2-4c62-9d92-aa457324de87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:03:32.106226 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71e3fb1-1ee2-4c62-9d92-aa457324de87 None admin] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:32.106712 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71e3fb1-1ee2-4c62-9d92-aa457324de87 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:32.107057 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-b3e8f546-73a9-48fe-ba53-aed7c46a55a9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 17:03:32.107057 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:03:32.107057 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:03:32.107057 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:03:32.107057 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:03:32.107057 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:03:32.107057 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:03:32.107057 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:03:32.107057 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:03:32.107057 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:03:32.107057 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:03:32.107057 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:03:32.107057 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 17:03:32.107057 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 17:03:32.107057 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 17:03:32.107057 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 17:03:32.108214 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 17:03:32.108214 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 17:03:32.108214 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 17:03:32.108214 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 17:03:32.108214 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:03:32.108214 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:03:32.108214 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:03:32.108214 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:03:32.108214 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:03:32.108214 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:03:32.108214 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:03:32.108214 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Jul 14 17:03:32.108214 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:03:32.108214 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:03:32.108214 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:03:32.108214 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:03:32.108976 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:03:32.108976 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:03:32.108976 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:03:32.108976 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:03:32.108976 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 17:03:32.108976 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 17:03:32.108976 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 17:03:32.108976 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 17:03:32.108976 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 17:03:32.108976 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 17:03:32.108976 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 17:03:32.108976 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Jul 14 17:03:32.108976 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 14/28] 10.222.0.136 () {56 vars in 1101 bytes} [Thu Jul 14 17:03:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 341 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 17:03:32.115201 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71e3fb1-1ee2-4c62-9d92-aa457324de87 None admin] PATH_INFO: `/v3/projects` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:32.115283 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6228be-3ec9-479b-b5fc-8e9d0aa12577 None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:32.115283 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6228be-3ec9-479b-b5fc-8e9d0aa12577 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:32.115413 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71e3fb1-1ee2-4c62-9d92-aa457324de87 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:03:32.115481 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6228be-3ec9-479b-b5fc-8e9d0aa12577 None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:32.115481 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 15/29] 10.222.0.136 () {54 vars in 931 bytes} [Thu Jul 14 17:03:32 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:03:32.115786 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71e3fb1-1ee2-4c62-9d92-aa457324de87 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:03:32.115877 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dc1e69-2aec-48fa-9651-bbe0bfd17c7d None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:32.115877 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dc1e69-2aec-48fa-9651-bbe0bfd17c7d None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:32.115877 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dc1e69-2aec-48fa-9651-bbe0bfd17c7d None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:32.115877 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 16/30] 10.222.0.136 () {54 vars in 931 bytes} [Thu Jul 14 17:03:32 2022] GET /identity => generated 271 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:03:32.115877 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dc1e69-2aec-48fa-9651-bbe0bfd17c7d None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:03:32.202635 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:03:32.252404 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dc1e69-2aec-48fa-9651-bbe0bfd17c7d None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:03:32.290103 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb26f4f3-f299-4d5d-a3d5-4270a55ea00f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:03:32.291281 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb26f4f3-f299-4d5d-a3d5-4270a55ea00f None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:32.291778 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb26f4f3-f299-4d5d-a3d5-4270a55ea00f None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:32.292302 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb26f4f3-f299-4d5d-a3d5-4270a55ea00f None admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:32.293377 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb26f4f3-f299-4d5d-a3d5-4270a55ea00f None admin] RBAC: Adding query filter params (name=admin) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:03:32.293917 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb26f4f3-f299-4d5d-a3d5-4270a55ea00f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:03:32.295591 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb26f4f3-f299-4d5d-a3d5-4270a55ea00f None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:03:32.306126 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 17/31] 10.222.0.136 () {56 vars in 1104 bytes} [Thu Jul 14 17:03:32 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:03:32.307684 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c0cb02-4eed-4ff6-abdc-27ab546551d2 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:32.308201 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c0cb02-4eed-4ff6-abdc-27ab546551d2 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:32.308687 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c0cb02-4eed-4ff6-abdc-27ab546551d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:32.313673 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 15/32] 10.222.0.136 () {60 vars in 1146 bytes} [Thu Jul 14 17:03:31 2022] POST /identity/v3/projects => generated 302 bytes in 466 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 17:03:32.318612 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb5ee06-870a-4f68-a1a5-907624a10f5a None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:32.319365 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb5ee06-870a-4f68-a1a5-907624a10f5a None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:32.320356 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb5ee06-870a-4f68-a1a5-907624a10f5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:32.348772 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-66c0cb02-4eed-4ff6-abdc-27ab546551d2 None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:03:32.352595 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-66c0cb02-4eed-4ff6-abdc-27ab546551d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:03:32.357875 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-1cb5ee06-870a-4f68-a1a5-907624a10f5a None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:03:32.362495 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-1cb5ee06-870a-4f68-a1a5-907624a10f5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:03:32.474434 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 18/33] 10.222.0.136 () {58 vars in 1028 bytes} [Thu Jul 14 17:03:32 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 17:03:32.481283 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c0cb02-4eed-4ff6-abdc-27ab546551d2 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:03:32.510096 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 16/34] 10.222.0.136 () {58 vars in 1028 bytes} [Thu Jul 14 17:03:32 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 17:03:32.544493 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb5ee06-870a-4f68-a1a5-907624a10f5a None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:03:32.571121 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:03:32.614069 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:03:32.636789 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c0cb02-4eed-4ff6-abdc-27ab546551d2 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:03:32.677367 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c7ccaf-ad6a-4dd6-9943-48650debc928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:03:32.678387 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c7ccaf-ad6a-4dd6-9943-48650debc928 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:32.678586 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c7ccaf-ad6a-4dd6-9943-48650debc928 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:32.678889 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c7ccaf-ad6a-4dd6-9943-48650debc928 None admin] PATH_INFO: `/v3/users/2178b080bea24cb2a1f6b50c1554ccd2` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:32.680644 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c7ccaf-ad6a-4dd6-9943-48650debc928 None admin] RBAC: Authorizing `identity:get_user(user_id=2178b080bea24cb2a1f6b50c1554ccd2)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:03:32.682246 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c7ccaf-ad6a-4dd6-9943-48650debc928 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:03:32.683955 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 19/35] 10.222.0.136 () {56 vars in 1182 bytes} [Thu Jul 14 17:03:32 2022] GET /identity/v3/users/2178b080bea24cb2a1f6b50c1554ccd2 => generated 248 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:03:32.684613 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c7ccaf-ad6a-4dd6-9943-48650debc928 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:03:32.685944 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb5ee06-870a-4f68-a1a5-907624a10f5a None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:03:32.723982 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0872368-135a-45ed-95f0-6ba197b74262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:03:32.725034 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0872368-135a-45ed-95f0-6ba197b74262 None admin] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:32.725521 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0872368-135a-45ed-95f0-6ba197b74262 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:32.726577 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0872368-135a-45ed-95f0-6ba197b74262 None admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:32.727614 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0872368-135a-45ed-95f0-6ba197b74262 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:03:32.729395 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0872368-135a-45ed-95f0-6ba197b74262 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:03:32.753457 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 17/36] 10.222.0.136 () {60 vars in 1136 bytes} [Thu Jul 14 17:03:32 2022] POST /identity/v3/roles => generated 226 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 17:03:32.754707 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0872368-135a-45ed-95f0-6ba197b74262 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:03:32.803070 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c7ccaf-ad6a-4dd6-9943-48650debc928 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:03:32.830094 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:03:32.855016 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97fdc9d-2717-4213-a718-16346f4d7cae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:03:32.855714 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97fdc9d-2717-4213-a718-16346f4d7cae None admin] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:32.856003 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97fdc9d-2717-4213-a718-16346f4d7cae None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:32.856289 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97fdc9d-2717-4213-a718-16346f4d7cae None admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:32.857152 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97fdc9d-2717-4213-a718-16346f4d7cae None admin] RBAC: Authorizing `identity:create_role()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:03:32.858912 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97fdc9d-2717-4213-a718-16346f4d7cae None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:03:32.878999 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:03:32.926796 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0872368-135a-45ed-95f0-6ba197b74262 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:03:32.974404 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5762aef6-37bb-43d8-9855-7615225d42c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:03:32.975688 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5762aef6-37bb-43d8-9855-7615225d42c4 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:32.976978 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5762aef6-37bb-43d8-9855-7615225d42c4 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:32.977525 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5762aef6-37bb-43d8-9855-7615225d42c4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:32.980123 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5762aef6-37bb-43d8-9855-7615225d42c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:03:32.982150 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5762aef6-37bb-43d8-9855-7615225d42c4 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:03:32.984403 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 18/37] 10.222.0.136 () {56 vars in 1113 bytes} [Thu Jul 14 17:03:32 2022] GET /identity/v3/domains/default => generated 200 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:03:32.990154 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5762aef6-37bb-43d8-9855-7615225d42c4 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:03:33.084683 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 20/38] 10.222.0.136 () {60 vars in 1136 bytes} [Thu Jul 14 17:03:32 2022] POST /identity/v3/roles => generated 220 bytes in 400 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 17:03:33.111317 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73918271-bd4b-4b6c-b5a3-55df763b9221 None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:33.111855 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73918271-bd4b-4b6c-b5a3-55df763b9221 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:33.112150 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5762aef6-37bb-43d8-9855-7615225d42c4 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:03:33.112269 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73918271-bd4b-4b6c-b5a3-55df763b9221 None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:33.113807 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 21/39] 10.222.0.136 () {54 vars in 931 bytes} [Thu Jul 14 17:03:33 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 14 17:03:33.123230 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771d2373-acae-4e9d-bb6a-e470cde77a34 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:33.123544 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771d2373-acae-4e9d-bb6a-e470cde77a34 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:33.123817 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771d2373-acae-4e9d-bb6a-e470cde77a34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:33.160038 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-771d2373-acae-4e9d-bb6a-e470cde77a34 None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:03:33.161624 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-771d2373-acae-4e9d-bb6a-e470cde77a34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:03:33.162744 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3efe09-f823-4c0a-9be4-3497305f410f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:03:33.165384 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3efe09-f823-4c0a-9be4-3497305f410f None admin] REQUEST_METHOD: `PUT` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:33.165994 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3efe09-f823-4c0a-9be4-3497305f410f None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:33.166579 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3efe09-f823-4c0a-9be4-3497305f410f None admin] PATH_INFO: `/v3/domains/default/users/2178b080bea24cb2a1f6b50c1554ccd2/roles/284c6314b4d3492085e397a87b0e3b51` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:33.176202 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3efe09-f823-4c0a-9be4-3497305f410f None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=2178b080bea24cb2a1f6b50c1554ccd2, role_id=284c6314b4d3492085e397a87b0e3b51)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:03:33.177086 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3efe09-f823-4c0a-9be4-3497305f410f None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:03:33.200945 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 19/40] 10.222.0.136 () {58 vars in 1366 bytes} [Thu Jul 14 17:03:32 2022] PUT /identity/v3/domains/default/users/2178b080bea24cb2a1f6b50c1554ccd2/roles/284c6314b4d3492085e397a87b0e3b51 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:03:33.201490 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:03:33.259360 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 22/41] 10.222.0.136 () {58 vars in 1028 bytes} [Thu Jul 14 17:03:33 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 17:03:33.286067 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3efe09-f823-4c0a-9be4-3497305f410f None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:03:33.316209 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7421f4b5-9d4b-41f9-9888-f8f72f6a80d5 None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:33.316874 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7421f4b5-9d4b-41f9-9888-f8f72f6a80d5 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:33.317373 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7421f4b5-9d4b-41f9-9888-f8f72f6a80d5 None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:33.319052 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 23/42] 10.222.0.136 () {54 vars in 931 bytes} [Thu Jul 14 17:03:33 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 14 17:03:33.326426 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b022e2-41e9-47f8-8e38-bf7bc43ee29e None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:33.327029 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b022e2-41e9-47f8-8e38-bf7bc43ee29e None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:33.327516 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b022e2-41e9-47f8-8e38-bf7bc43ee29e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:33.350065 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-30b022e2-41e9-47f8-8e38-bf7bc43ee29e None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:03:33.351317 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-30b022e2-41e9-47f8-8e38-bf7bc43ee29e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:03:33.439787 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3efe09-f823-4c0a-9be4-3497305f410f None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:03:33.444344 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 24/43] 10.222.0.136 () {58 vars in 1028 bytes} [Thu Jul 14 17:03:33 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 17:03:33.470342 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b022e2-41e9-47f8-8e38-bf7bc43ee29e None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:03:33.479138 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de20fc3-2386-4311-bd22-7b0cd6cc09de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:03:33.480321 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de20fc3-2386-4311-bd22-7b0cd6cc09de None admin] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:33.480619 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de20fc3-2386-4311-bd22-7b0cd6cc09de None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:33.480958 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de20fc3-2386-4311-bd22-7b0cd6cc09de None admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:33.482150 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de20fc3-2386-4311-bd22-7b0cd6cc09de None admin] RBAC: Authorizing `identity:create_role()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:03:33.484411 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de20fc3-2386-4311-bd22-7b0cd6cc09de None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:03:33.502207 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 20/44] 10.222.0.136 () {60 vars in 1136 bytes} [Thu Jul 14 17:03:33 2022] POST /identity/v3/roles => generated 224 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 17:03:33.531976 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:03:33.599576 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b022e2-41e9-47f8-8e38-bf7bc43ee29e None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:03:33.639203 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e6be40-141e-4dfc-9c54-83c4676d8f52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:03:33.640112 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e6be40-141e-4dfc-9c54-83c4676d8f52 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:33.640411 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e6be40-141e-4dfc-9c54-83c4676d8f52 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:33.640698 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e6be40-141e-4dfc-9c54-83c4676d8f52 None admin] PATH_INFO: `/v3/domains/default` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:33.642010 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e6be40-141e-4dfc-9c54-83c4676d8f52 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:03:33.643634 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e6be40-141e-4dfc-9c54-83c4676d8f52 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:03:33.650606 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 25/45] 10.222.0.136 () {56 vars in 1113 bytes} [Thu Jul 14 17:03:33 2022] GET /identity/v3/domains/default => generated 200 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 17:03:33.652287 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de20fc3-2386-4311-bd22-7b0cd6cc09de None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:03:33.717978 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:03:33.765511 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de20fc3-2386-4311-bd22-7b0cd6cc09de None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:03:33.799219 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8493cd-08bc-45aa-839d-13a690ff18ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:03:33.799880 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8493cd-08bc-45aa-839d-13a690ff18ef None admin] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:33.800169 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8493cd-08bc-45aa-839d-13a690ff18ef None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:33.800452 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8493cd-08bc-45aa-839d-13a690ff18ef None admin] PATH_INFO: `/v3/projects` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:33.801174 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8493cd-08bc-45aa-839d-13a690ff18ef None admin] RBAC: Authorizing `identity:create_project()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:03:33.802662 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8493cd-08bc-45aa-839d-13a690ff18ef None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:03:33.827473 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 21/46] 10.222.0.136 () {60 vars in 1146 bytes} [Thu Jul 14 17:03:33 2022] POST /identity/v3/projects => generated 313 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 17:03:35.610749 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd821df-7237-4c4e-91d6-c8620dc6921a None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:35.611233 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd821df-7237-4c4e-91d6-c8620dc6921a None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:35.611233 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd821df-7237-4c4e-91d6-c8620dc6921a None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:35.612599 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 26/47] 10.222.0.136 () {54 vars in 931 bytes} [Thu Jul 14 17:03:35 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:03:35.618806 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ec9051-ad59-4fe5-b40f-026675bd8923 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:35.619259 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ec9051-ad59-4fe5-b40f-026675bd8923 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:35.619382 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ec9051-ad59-4fe5-b40f-026675bd8923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:35.636750 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-36ec9051-ad59-4fe5-b40f-026675bd8923 None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:03:35.637990 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-36ec9051-ad59-4fe5-b40f-026675bd8923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:03:35.705669 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 22/48] 10.222.0.136 () {58 vars in 1028 bytes} [Thu Jul 14 17:03:35 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 17:03:35.730864 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd821df-7237-4c4e-91d6-c8620dc6921a None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:03:35.844865 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd821df-7237-4c4e-91d6-c8620dc6921a None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:03:35.859278 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:03:35.881355 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48b8540-90c5-4e9b-98da-b23654824242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:03:35.882321 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48b8540-90c5-4e9b-98da-b23654824242 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:35.882837 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48b8540-90c5-4e9b-98da-b23654824242 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:35.883139 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48b8540-90c5-4e9b-98da-b23654824242 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:35.893359 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48b8540-90c5-4e9b-98da-b23654824242 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 17:03:35.901409 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-c48b8540-90c5-4e9b-98da-b23654824242 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 17:03:35.901409 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:03:35.901409 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:03:35.901409 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:03:35.901409 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:03:35.901409 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:03:35.901409 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:03:35.901409 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:03:35.901409 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:03:35.901409 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:03:35.901409 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:03:35.901409 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:03:35.901409 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 17:03:35.901409 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 17:03:35.901409 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 17:03:35.901409 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 17:03:35.902271 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 17:03:35.902271 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 17:03:35.902271 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 17:03:35.902271 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 17:03:35.902271 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:03:35.902271 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:03:35.902271 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:03:35.902271 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:03:35.902271 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:03:35.902271 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:03:35.902271 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:03:35.902271 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Jul 14 17:03:35.902271 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:03:35.902271 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:03:35.902271 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:03:35.902271 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:03:35.903025 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:03:35.903025 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:03:35.903025 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:03:35.903025 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:03:35.903025 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 17:03:35.903025 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 17:03:35.903025 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 17:03:35.903025 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 17:03:35.903025 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 17:03:35.903025 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 17:03:35.903025 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 17:03:35.903025 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Jul 14 17:03:35.903025 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 27/49] 10.222.0.136 () {56 vars in 1101 bytes} [Thu Jul 14 17:03:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:03:35.908667 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ec9051-ad59-4fe5-b40f-026675bd8923 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:03:35.953478 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:03:36.016931 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ec9051-ad59-4fe5-b40f-026675bd8923 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:03:36.050489 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd618f60-717e-42e3-b8a8-122bf6ad0eb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:03:36.051161 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd618f60-717e-42e3-b8a8-122bf6ad0eb9 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:36.051454 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd618f60-717e-42e3-b8a8-122bf6ad0eb9 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:36.051739 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd618f60-717e-42e3-b8a8-122bf6ad0eb9 None admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:36.052488 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd618f60-717e-42e3-b8a8-122bf6ad0eb9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:03:36.052801 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd618f60-717e-42e3-b8a8-122bf6ad0eb9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:03:36.054400 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd618f60-717e-42e3-b8a8-122bf6ad0eb9 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:03:36.065877 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 23/50] 10.222.0.136 () {56 vars in 1104 bytes} [Thu Jul 14 17:03:35 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:03:36.071916 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48b8540-90c5-4e9b-98da-b23654824242 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:03:36.106522 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a894bac-ddcf-4120-883e-5fd852b10594 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:36.106824 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a894bac-ddcf-4120-883e-5fd852b10594 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:36.107120 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a894bac-ddcf-4120-883e-5fd852b10594 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:36.108755 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 24/51] 10.222.0.136 () {54 vars in 931 bytes} [Thu Jul 14 17:03:36 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 14 17:03:36.113873 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15423e8a-861b-499c-8b00-f1bbf94b03aa None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:36.114176 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15423e8a-861b-499c-8b00-f1bbf94b03aa None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:36.114467 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15423e8a-861b-499c-8b00-f1bbf94b03aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:36.131616 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-15423e8a-861b-499c-8b00-f1bbf94b03aa None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:03:36.133693 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-15423e8a-861b-499c-8b00-f1bbf94b03aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:03:36.176312 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48b8540-90c5-4e9b-98da-b23654824242 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:03:36.204773 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 25/52] 10.222.0.136 () {58 vars in 1028 bytes} [Thu Jul 14 17:03:36 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 17:03:36.214398 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1a6c23-dd3e-4eca-abb6-b5af8d9572e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:03:36.215294 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1a6c23-dd3e-4eca-abb6-b5af8d9572e5 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:36.215590 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1a6c23-dd3e-4eca-abb6-b5af8d9572e5 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:36.215879 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1a6c23-dd3e-4eca-abb6-b5af8d9572e5 None admin] PATH_INFO: `/v3/users/2178b080bea24cb2a1f6b50c1554ccd2` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:36.217086 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1a6c23-dd3e-4eca-abb6-b5af8d9572e5 None admin] RBAC: Authorizing `identity:get_user(user_id=2178b080bea24cb2a1f6b50c1554ccd2)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:03:36.218588 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1a6c23-dd3e-4eca-abb6-b5af8d9572e5 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:03:36.220397 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 28/53] 10.222.0.136 () {56 vars in 1182 bytes} [Thu Jul 14 17:03:36 2022] GET /identity/v3/users/2178b080bea24cb2a1f6b50c1554ccd2 => generated 248 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:03:36.225632 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15423e8a-861b-499c-8b00-f1bbf94b03aa None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:03:36.230170 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1a6c23-dd3e-4eca-abb6-b5af8d9572e5 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:03:36.257754 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:03:36.273798 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:03:36.329556 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15423e8a-861b-499c-8b00-f1bbf94b03aa None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:03:36.332127 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1a6c23-dd3e-4eca-abb6-b5af8d9572e5 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:03:36.365592 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f78a3cf-0ff9-4fdc-8826-8271d489f3f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:03:36.366171 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa086d9-37b6-4935-85f6-10f1eff4beea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:03:36.366585 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f78a3cf-0ff9-4fdc-8826-8271d489f3f8 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:36.366900 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f78a3cf-0ff9-4fdc-8826-8271d489f3f8 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:36.367094 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa086d9-37b6-4935-85f6-10f1eff4beea None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:36.367213 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f78a3cf-0ff9-4fdc-8826-8271d489f3f8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:36.367365 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa086d9-37b6-4935-85f6-10f1eff4beea None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:36.367639 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa086d9-37b6-4935-85f6-10f1eff4beea None admin] PATH_INFO: `/v3/domains/default` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:36.368378 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f78a3cf-0ff9-4fdc-8826-8271d489f3f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:03:36.368821 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa086d9-37b6-4935-85f6-10f1eff4beea None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:03:36.369884 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f78a3cf-0ff9-4fdc-8826-8271d489f3f8 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:03:36.370278 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa086d9-37b6-4935-85f6-10f1eff4beea None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:03:36.371515 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 26/54] 10.222.0.136 () {56 vars in 1113 bytes} [Thu Jul 14 17:03:36 2022] GET /identity/v3/domains/default => generated 200 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:03:36.371947 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 29/55] 10.222.0.136 () {56 vars in 1113 bytes} [Thu Jul 14 17:03:36 2022] GET /identity/v3/domains/default => generated 200 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 17:03:36.377243 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f78a3cf-0ff9-4fdc-8826-8271d489f3f8 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:03:36.377364 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa086d9-37b6-4935-85f6-10f1eff4beea None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:03:36.475584 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:03:36.477354 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa086d9-37b6-4935-85f6-10f1eff4beea None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:03:36.479635 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f78a3cf-0ff9-4fdc-8826-8271d489f3f8 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:03:36.487288 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:03:36.513952 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e4d893-60ca-46c6-b102-dac82a61f45b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:03:36.514618 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e4d893-60ca-46c6-b102-dac82a61f45b None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:36.514908 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e4d893-60ca-46c6-b102-dac82a61f45b None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:36.515191 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e4d893-60ca-46c6-b102-dac82a61f45b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:36.516014 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e4d893-60ca-46c6-b102-dac82a61f45b None admin] RBAC: Adding query filter params (role.id=284c6314b4d3492085e397a87b0e3b51, scope.domain.id=default, user.id=2178b080bea24cb2a1f6b50c1554ccd2) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:03:36.516329 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e4d893-60ca-46c6-b102-dac82a61f45b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:03:36.517788 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e4d893-60ca-46c6-b102-dac82a61f45b None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:03:36.517957 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89e3532-8afe-4e6a-a15e-bfffa2a261b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:03:36.518625 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89e3532-8afe-4e6a-a15e-bfffa2a261b3 None admin] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:36.518919 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89e3532-8afe-4e6a-a15e-bfffa2a261b3 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:36.519203 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89e3532-8afe-4e6a-a15e-bfffa2a261b3 None admin] PATH_INFO: `/v3/projects` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:36.519954 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89e3532-8afe-4e6a-a15e-bfffa2a261b3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:03:36.521401 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89e3532-8afe-4e6a-a15e-bfffa2a261b3 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:03:36.524099 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 30/56] 10.222.0.136 () {56 vars in 1327 bytes} [Thu Jul 14 17:03:36 2022] GET /identity/v3/role_assignments?user.id=2178b080bea24cb2a1f6b50c1554ccd2&scope.domain.id=default&role.id=284c6314b4d3492085e397a87b0e3b51 => generated 532 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 17:03:36.548823 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 27/57] 10.222.0.136 () {60 vars in 1145 bytes} [Thu Jul 14 17:03:36 2022] POST /identity/v3/projects => generated 299 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 17:03:38.805158 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e745972-998c-47fc-bd9f-34d7a849b6b4 None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:38.805741 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e745972-998c-47fc-bd9f-34d7a849b6b4 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:38.805741 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e745972-998c-47fc-bd9f-34d7a849b6b4 None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:38.807240 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 31/58] 10.222.0.136 () {54 vars in 931 bytes} [Thu Jul 14 17:03:38 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:03:38.812482 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a138f4a8-dde9-4b5e-80fe-f5c13914acfd None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:38.812873 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a138f4a8-dde9-4b5e-80fe-f5c13914acfd None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:38.813053 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a138f4a8-dde9-4b5e-80fe-f5c13914acfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:38.829938 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-a138f4a8-dde9-4b5e-80fe-f5c13914acfd None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:03:38.831116 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-a138f4a8-dde9-4b5e-80fe-f5c13914acfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:03:38.898332 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 28/59] 10.222.0.136 () {58 vars in 1028 bytes} [Thu Jul 14 17:03:38 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 17:03:38.924078 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e745972-998c-47fc-bd9f-34d7a849b6b4 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:03:39.026928 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e745972-998c-47fc-bd9f-34d7a849b6b4 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:03:39.060884 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176b5810-72f8-4f57-8406-dd2e8537b335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:03:39.061635 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176b5810-72f8-4f57-8406-dd2e8537b335 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:39.061932 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176b5810-72f8-4f57-8406-dd2e8537b335 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:39.062222 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176b5810-72f8-4f57-8406-dd2e8537b335 None admin] PATH_INFO: `/v3/domains/default` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:39.063408 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176b5810-72f8-4f57-8406-dd2e8537b335 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:03:39.064868 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176b5810-72f8-4f57-8406-dd2e8537b335 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:03:39.066507 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 32/60] 10.222.0.136 () {56 vars in 1113 bytes} [Thu Jul 14 17:03:38 2022] GET /identity/v3/domains/default => generated 200 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:03:39.072178 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a138f4a8-dde9-4b5e-80fe-f5c13914acfd None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:03:39.152729 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:03:39.171601 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a138f4a8-dde9-4b5e-80fe-f5c13914acfd None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:03:39.204546 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03b5b1c-8f14-40f0-be69-3f3f834db51a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:03:39.205220 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03b5b1c-8f14-40f0-be69-3f3f834db51a None admin] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:39.205511 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03b5b1c-8f14-40f0-be69-3f3f834db51a None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:39.205822 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03b5b1c-8f14-40f0-be69-3f3f834db51a None admin] PATH_INFO: `/v3/users` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:39.206544 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03b5b1c-8f14-40f0-be69-3f3f834db51a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:03:39.207981 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03b5b1c-8f14-40f0-be69-3f3f834db51a None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:03:39.233620 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 29/61] 10.222.0.136 () {60 vars in 1137 bytes} [Thu Jul 14 17:03:39 2022] POST /identity/v3/users => generated 276 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 17:03:42.847048 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e113bdd4-b26c-438a-b48f-00b6128025c8 None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:42.848082 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e113bdd4-b26c-438a-b48f-00b6128025c8 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:42.848603 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e113bdd4-b26c-438a-b48f-00b6128025c8 None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:42.850227 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 33/62] 10.222.0.136 () {54 vars in 931 bytes} [Thu Jul 14 17:03:42 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:03:42.856850 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8ebd8c-d961-440c-8433-f3259c603dd3 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:42.858116 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8ebd8c-d961-440c-8433-f3259c603dd3 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:42.858600 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8ebd8c-d961-440c-8433-f3259c603dd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:42.882633 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-4f8ebd8c-d961-440c-8433-f3259c603dd3 None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:03:42.884330 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-4f8ebd8c-d961-440c-8433-f3259c603dd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:03:42.927179 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477aec6a-968e-4fe2-b26b-c4ecaea11ba7 None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:42.927792 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477aec6a-968e-4fe2-b26b-c4ecaea11ba7 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:42.928273 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477aec6a-968e-4fe2-b26b-c4ecaea11ba7 None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:42.930913 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 34/63] 10.222.0.136 () {54 vars in 931 bytes} [Thu Jul 14 17:03:42 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:03:42.935957 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51be9aae-6d10-4aad-a761-bc0be3b1c87f None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:42.936540 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51be9aae-6d10-4aad-a761-bc0be3b1c87f None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:42.937171 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51be9aae-6d10-4aad-a761-bc0be3b1c87f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:42.967378 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-51be9aae-6d10-4aad-a761-bc0be3b1c87f None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:03:42.968581 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-51be9aae-6d10-4aad-a761-bc0be3b1c87f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:03:42.993444 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 30/64] 10.222.0.136 () {58 vars in 1028 bytes} [Thu Jul 14 17:03:42 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 17:03:43.021812 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4ed663-d602-4c40-8d0a-81cbc7c4ab9a None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:43.022117 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4ed663-d602-4c40-8d0a-81cbc7c4ab9a None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:43.022907 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4ed663-d602-4c40-8d0a-81cbc7c4ab9a None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:43.024618 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 31/65] 10.222.0.136 () {54 vars in 931 bytes} [Thu Jul 14 17:03:43 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 14 17:03:43.031092 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4711fe7-8f8f-4116-8849-ca7a468540bf None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:43.031402 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4711fe7-8f8f-4116-8849-ca7a468540bf None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:43.031674 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4711fe7-8f8f-4116-8849-ca7a468540bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:43.044840 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:03:43.051291 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-b4711fe7-8f8f-4116-8849-ca7a468540bf None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:03:43.052953 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-b4711fe7-8f8f-4116-8849-ca7a468540bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:03:43.087915 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 35/66] 10.222.0.136 () {58 vars in 1028 bytes} [Thu Jul 14 17:03:42 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 17:03:43.093757 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51be9aae-6d10-4aad-a761-bc0be3b1c87f None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:03:43.150024 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:03:43.156853 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 32/67] 10.222.0.136 () {58 vars in 1028 bytes} [Thu Jul 14 17:03:43 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 17:03:43.163122 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4711fe7-8f8f-4116-8849-ca7a468540bf None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:03:43.248893 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51be9aae-6d10-4aad-a761-bc0be3b1c87f None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:03:43.285927 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4711fe7-8f8f-4116-8849-ca7a468540bf None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:03:43.292769 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9be84a-5b33-4240-bd40-8e338eed0a69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:03:43.293600 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9be84a-5b33-4240-bd40-8e338eed0a69 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:43.294146 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9be84a-5b33-4240-bd40-8e338eed0a69 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:43.294146 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9be84a-5b33-4240-bd40-8e338eed0a69 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:43.305411 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9be84a-5b33-4240-bd40-8e338eed0a69 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 17:03:43.313087 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-df9be84a-5b33-4240-bd40-8e338eed0a69 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 17:03:43.313087 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:03:43.313087 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:03:43.313087 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:03:43.313087 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:03:43.313087 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:03:43.313087 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:03:43.313087 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:03:43.313087 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:03:43.313087 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:03:43.313087 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:03:43.313087 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:03:43.313087 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 17:03:43.313087 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 17:03:43.313087 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 17:03:43.313087 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 17:03:43.313961 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 17:03:43.313961 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 17:03:43.313961 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 17:03:43.313961 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 17:03:43.313961 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:03:43.313961 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:03:43.313961 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:03:43.313961 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:03:43.313961 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:03:43.313961 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:03:43.313961 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:03:43.313961 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Jul 14 17:03:43.313961 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:03:43.313961 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:03:43.313961 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:03:43.313961 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:03:43.314728 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:03:43.314728 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:03:43.314728 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:03:43.314728 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:03:43.314728 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 17:03:43.314728 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 17:03:43.314728 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 17:03:43.314728 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 17:03:43.314728 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 17:03:43.314728 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 17:03:43.314728 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 17:03:43.314728 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Jul 14 17:03:43.314728 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 36/68] 10.222.0.136 () {56 vars in 1101 bytes} [Thu Jul 14 17:03:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:03:43.316283 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9be84a-5b33-4240-bd40-8e338eed0a69 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:03:43.326984 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9730a61c-81ed-44f7-a97b-69acba46ea31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:03:43.327787 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9730a61c-81ed-44f7-a97b-69acba46ea31 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:43.328378 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9730a61c-81ed-44f7-a97b-69acba46ea31 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:43.328378 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9730a61c-81ed-44f7-a97b-69acba46ea31 None admin] PATH_INFO: `/v3/roles/member` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:43.342837 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9730a61c-81ed-44f7-a97b-69acba46ea31 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 17:03:43.351235 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:03:43.352821 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-9730a61c-81ed-44f7-a97b-69acba46ea31 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 17:03:43.352821 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:03:43.352821 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:03:43.352821 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:03:43.352821 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:03:43.352821 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:03:43.352821 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:03:43.352821 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:03:43.352821 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:03:43.352821 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:03:43.352821 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:03:43.352821 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:03:43.352821 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 17:03:43.352821 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 17:03:43.352821 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 17:03:43.352821 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 17:03:43.354597 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 17:03:43.354597 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 17:03:43.354597 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 17:03:43.354597 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 17:03:43.354597 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:03:43.354597 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:03:43.354597 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:03:43.354597 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:03:43.354597 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:03:43.354597 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:03:43.354597 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:03:43.354597 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Jul 14 17:03:43.354597 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:03:43.354597 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:03:43.354597 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:03:43.354597 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:03:43.355710 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:03:43.355710 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:03:43.355710 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:03:43.355710 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:03:43.355710 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 17:03:43.355710 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 17:03:43.355710 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 17:03:43.355710 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 17:03:43.355710 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 17:03:43.355710 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 17:03:43.355710 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 17:03:43.355710 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Jul 14 17:03:43.355710 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 33/69] 10.222.0.136 () {56 vars in 1104 bytes} [Thu Jul 14 17:03:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:03:43.355710 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b822ce9-dfaf-4d63-8013-06d19de8fce7 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:43.356401 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b822ce9-dfaf-4d63-8013-06d19de8fce7 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:43.356401 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b822ce9-dfaf-4d63-8013-06d19de8fce7 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:43.358946 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 34/70] 10.222.0.136 () {54 vars in 931 bytes} [Thu Jul 14 17:03:43 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:03:43.358946 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b822ce9-dfaf-4d63-8013-06d19de8fce7 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:03:43.419533 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:03:43.426402 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9be84a-5b33-4240-bd40-8e338eed0a69 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:03:43.463893 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b822ce9-dfaf-4d63-8013-06d19de8fce7 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:03:43.466846 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221e27b9-34ad-4992-a1a5-c0f30df0906b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:03:43.467679 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221e27b9-34ad-4992-a1a5-c0f30df0906b None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:43.467974 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221e27b9-34ad-4992-a1a5-c0f30df0906b None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:43.468264 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221e27b9-34ad-4992-a1a5-c0f30df0906b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:43.479579 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221e27b9-34ad-4992-a1a5-c0f30df0906b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 17:03:43.487974 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-221e27b9-34ad-4992-a1a5-c0f30df0906b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 17:03:43.487974 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:03:43.487974 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:03:43.487974 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:03:43.487974 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:03:43.487974 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:03:43.487974 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:03:43.487974 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:03:43.487974 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:03:43.487974 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:03:43.487974 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:03:43.487974 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:03:43.487974 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 17:03:43.487974 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 17:03:43.487974 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 17:03:43.487974 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 17:03:43.488826 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 17:03:43.488826 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 17:03:43.488826 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 17:03:43.488826 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 17:03:43.488826 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:03:43.488826 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:03:43.488826 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:03:43.488826 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:03:43.488826 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:03:43.488826 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:03:43.488826 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:03:43.488826 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Jul 14 17:03:43.488826 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:03:43.488826 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:03:43.488826 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:03:43.488826 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:03:43.489601 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:03:43.489601 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:03:43.489601 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:03:43.489601 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:03:43.489601 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 17:03:43.489601 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 17:03:43.489601 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 17:03:43.489601 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 17:03:43.489601 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 17:03:43.489601 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 17:03:43.489601 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 17:03:43.489601 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Jul 14 17:03:43.489601 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 37/71] 10.222.0.136 () {56 vars in 1119 bytes} [Thu Jul 14 17:03:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:03:43.495337 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c961974-5866-4b98-a013-1d3bc20c8502 None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:43.495647 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c961974-5866-4b98-a013-1d3bc20c8502 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:43.495947 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c961974-5866-4b98-a013-1d3bc20c8502 None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:43.497268 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 38/72] 10.222.0.136 () {54 vars in 931 bytes} [Thu Jul 14 17:03:43 2022] GET /identity => generated 271 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:03:43.501276 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c961974-5866-4b98-a013-1d3bc20c8502 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:03:43.501357 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13711dae-36b8-4bc1-8230-5cf9e468c4ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:03:43.501357 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13711dae-36b8-4bc1-8230-5cf9e468c4ba None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:43.501357 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13711dae-36b8-4bc1-8230-5cf9e468c4ba None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:43.501357 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13711dae-36b8-4bc1-8230-5cf9e468c4ba None admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:43.501808 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13711dae-36b8-4bc1-8230-5cf9e468c4ba None admin] RBAC: Adding query filter params (name=admin) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:03:43.502120 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13711dae-36b8-4bc1-8230-5cf9e468c4ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:03:43.503508 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13711dae-36b8-4bc1-8230-5cf9e468c4ba None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:03:43.512575 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 35/73] 10.222.0.136 () {56 vars in 1104 bytes} [Thu Jul 14 17:03:43 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:03:43.514004 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243ad6db-4f23-448d-967d-3f8dce474dde None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:43.514304 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243ad6db-4f23-448d-967d-3f8dce474dde None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:43.514640 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243ad6db-4f23-448d-967d-3f8dce474dde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:43.532097 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-243ad6db-4f23-448d-967d-3f8dce474dde None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:03:43.533301 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-243ad6db-4f23-448d-967d-3f8dce474dde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:03:43.590994 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:03:43.601225 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 36/74] 10.222.0.136 () {58 vars in 1028 bytes} [Thu Jul 14 17:03:43 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 17:03:43.602167 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243ad6db-4f23-448d-967d-3f8dce474dde None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:03:43.613998 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c961974-5866-4b98-a013-1d3bc20c8502 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:03:43.649190 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca0ffd4-2c54-42fa-acd6-988ef03d1c51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:03:43.650259 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca0ffd4-2c54-42fa-acd6-988ef03d1c51 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:43.650554 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca0ffd4-2c54-42fa-acd6-988ef03d1c51 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:43.650838 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca0ffd4-2c54-42fa-acd6-988ef03d1c51 None admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:43.651603 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca0ffd4-2c54-42fa-acd6-988ef03d1c51 None admin] RBAC: Adding query filter params (name=member) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:03:43.651905 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca0ffd4-2c54-42fa-acd6-988ef03d1c51 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:03:43.652838 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:03:43.653308 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca0ffd4-2c54-42fa-acd6-988ef03d1c51 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:03:43.662666 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 39/75] 10.222.0.136 () {56 vars in 1106 bytes} [Thu Jul 14 17:03:43 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:03:43.664217 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b774d7d7-b770-42b3-9cb5-6787b3043173 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:43.664512 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b774d7d7-b770-42b3-9cb5-6787b3043173 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:43.664795 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b774d7d7-b770-42b3-9cb5-6787b3043173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:43.681210 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-b774d7d7-b770-42b3-9cb5-6787b3043173 None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:03:43.682383 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-b774d7d7-b770-42b3-9cb5-6787b3043173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:03:43.707037 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243ad6db-4f23-448d-967d-3f8dce474dde None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:03:43.741695 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9371b958-7a65-4e7b-9df3-3e336178b11e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:03:43.742508 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9371b958-7a65-4e7b-9df3-3e336178b11e None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:43.742807 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9371b958-7a65-4e7b-9df3-3e336178b11e None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:43.743088 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9371b958-7a65-4e7b-9df3-3e336178b11e None admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:43.743843 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9371b958-7a65-4e7b-9df3-3e336178b11e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:03:43.744224 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9371b958-7a65-4e7b-9df3-3e336178b11e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:03:43.745627 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9371b958-7a65-4e7b-9df3-3e336178b11e None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:03:43.750014 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 40/76] 10.222.0.136 () {58 vars in 1028 bytes} [Thu Jul 14 17:03:43 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 17:03:43.750640 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b774d7d7-b770-42b3-9cb5-6787b3043173 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:03:43.765151 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 37/77] 10.222.0.136 () {56 vars in 1116 bytes} [Thu Jul 14 17:03:43 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:03:43.766325 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9371b958-7a65-4e7b-9df3-3e336178b11e None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:03:43.841157 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:03:43.870494 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b774d7d7-b770-42b3-9cb5-6787b3043173 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:03:43.875996 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9371b958-7a65-4e7b-9df3-3e336178b11e None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:03:43.889197 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:03:43.905300 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228ff1ab-208e-4a00-9701-9f77a4a20909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:03:43.906226 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228ff1ab-208e-4a00-9701-9f77a4a20909 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:43.906521 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228ff1ab-208e-4a00-9701-9f77a4a20909 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:43.906803 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228ff1ab-208e-4a00-9701-9f77a4a20909 None admin] PATH_INFO: `/v3/users/2178b080bea24cb2a1f6b50c1554ccd2` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:43.908020 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228ff1ab-208e-4a00-9701-9f77a4a20909 None admin] RBAC: Authorizing `identity:get_user(user_id=2178b080bea24cb2a1f6b50c1554ccd2)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:03:43.909478 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228ff1ab-208e-4a00-9701-9f77a4a20909 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:03:43.910974 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51be36c-ebf0-4fb0-b189-c2a672eaf54f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:03:43.911134 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 41/78] 10.222.0.136 () {56 vars in 1182 bytes} [Thu Jul 14 17:03:43 2022] GET /identity/v3/users/2178b080bea24cb2a1f6b50c1554ccd2 => generated 248 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:03:43.911775 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51be36c-ebf0-4fb0-b189-c2a672eaf54f None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:43.911933 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228ff1ab-208e-4a00-9701-9f77a4a20909 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:03:43.912082 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51be36c-ebf0-4fb0-b189-c2a672eaf54f None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:43.912351 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51be36c-ebf0-4fb0-b189-c2a672eaf54f None admin] PATH_INFO: `/v3/domains/default` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:43.914468 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51be36c-ebf0-4fb0-b189-c2a672eaf54f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:03:43.915628 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51be36c-ebf0-4fb0-b189-c2a672eaf54f None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:03:43.917310 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 38/79] 10.222.0.136 () {56 vars in 1113 bytes} [Thu Jul 14 17:03:43 2022] GET /identity/v3/domains/default => generated 200 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:03:43.918125 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51be36c-ebf0-4fb0-b189-c2a672eaf54f None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:03:44.017725 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228ff1ab-208e-4a00-9701-9f77a4a20909 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:03:44.021030 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51be36c-ebf0-4fb0-b189-c2a672eaf54f None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:03:44.052375 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c2ae6f-9175-4b80-80c3-d21f27b5299f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:03:44.053254 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c2ae6f-9175-4b80-80c3-d21f27b5299f None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:44.054113 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c2ae6f-9175-4b80-80c3-d21f27b5299f None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:44.054822 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c2ae6f-9175-4b80-80c3-d21f27b5299f None admin] PATH_INFO: `/v3/users/4a702add54724509bfb0e585a8aa4add` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:44.056272 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69802417-7ad9-49a3-9a09-5fe55b7e3b0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:03:44.057136 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69802417-7ad9-49a3-9a09-5fe55b7e3b0c None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:44.057422 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69802417-7ad9-49a3-9a09-5fe55b7e3b0c None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:44.057731 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69802417-7ad9-49a3-9a09-5fe55b7e3b0c None admin] PATH_INFO: `/v3/users/4a702add54724509bfb0e585a8aa4add` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:44.068049 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c2ae6f-9175-4b80-80c3-d21f27b5299f None admin] RBAC: Authorizing `identity:get_user(user_id=4a702add54724509bfb0e585a8aa4add)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:03:44.069830 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c2ae6f-9175-4b80-80c3-d21f27b5299f None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:03:44.071639 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 42/80] 10.222.0.136 () {56 vars in 1182 bytes} [Thu Jul 14 17:03:43 2022] GET /identity/v3/users/4a702add54724509bfb0e585a8aa4add => generated 276 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:03:44.072418 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c2ae6f-9175-4b80-80c3-d21f27b5299f None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:03:44.072604 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69802417-7ad9-49a3-9a09-5fe55b7e3b0c None admin] RBAC: Authorizing `identity:get_user(user_id=4a702add54724509bfb0e585a8aa4add)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:03:44.074153 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69802417-7ad9-49a3-9a09-5fe55b7e3b0c None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:03:44.075943 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 39/81] 10.222.0.136 () {56 vars in 1182 bytes} [Thu Jul 14 17:03:43 2022] GET /identity/v3/users/4a702add54724509bfb0e585a8aa4add => generated 276 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:03:44.076761 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69802417-7ad9-49a3-9a09-5fe55b7e3b0c None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:03:44.084136 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:03:44.117722 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:03:44.175463 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c2ae6f-9175-4b80-80c3-d21f27b5299f None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:03:44.179972 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69802417-7ad9-49a3-9a09-5fe55b7e3b0c None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:03:44.212550 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8754b676-2d80-49d2-ab9f-6b62f7ec60f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:03:44.213362 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8754b676-2d80-49d2-ab9f-6b62f7ec60f6 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:44.213688 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8754b676-2d80-49d2-ab9f-6b62f7ec60f6 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:44.213971 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8754b676-2d80-49d2-ab9f-6b62f7ec60f6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:44.214293 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00be5feb-7f29-44f9-abe0-91c6090a9ad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:03:44.214953 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00be5feb-7f29-44f9-abe0-91c6090a9ad8 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:44.215239 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00be5feb-7f29-44f9-abe0-91c6090a9ad8 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:44.215520 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00be5feb-7f29-44f9-abe0-91c6090a9ad8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:44.224273 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8754b676-2d80-49d2-ab9f-6b62f7ec60f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 17:03:44.234380 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-8754b676-2d80-49d2-ab9f-6b62f7ec60f6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 17:03:44.234380 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:03:44.234380 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:03:44.234380 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:03:44.234380 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:03:44.234380 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:03:44.234380 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:03:44.234380 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:03:44.234380 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:03:44.234380 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:03:44.234380 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:03:44.234380 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:03:44.234380 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 17:03:44.234380 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 17:03:44.234380 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 17:03:44.234380 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 17:03:44.235475 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 17:03:44.235475 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 17:03:44.235475 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 17:03:44.235475 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 17:03:44.235475 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:03:44.235475 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:03:44.235475 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:03:44.235475 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:03:44.235475 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:03:44.235475 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:03:44.235475 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:03:44.235475 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Jul 14 17:03:44.235475 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:03:44.235475 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:03:44.235475 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:03:44.235475 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:03:44.242043 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:03:44.242043 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:03:44.242043 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:03:44.242043 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:03:44.242043 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 17:03:44.242043 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 17:03:44.242043 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 17:03:44.242043 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 17:03:44.242043 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 17:03:44.242043 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 17:03:44.242043 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 17:03:44.242043 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Jul 14 17:03:44.242043 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 43/82] 10.222.0.136 () {56 vars in 1104 bytes} [Thu Jul 14 17:03:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:03:44.242043 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8754b676-2d80-49d2-ab9f-6b62f7ec60f6 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:03:44.286665 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00be5feb-7f29-44f9-abe0-91c6090a9ad8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:03:44.288236 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00be5feb-7f29-44f9-abe0-91c6090a9ad8 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:03:44.303253 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:03:44.326898 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:03:44.338825 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8754b676-2d80-49d2-ab9f-6b62f7ec60f6 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:03:44.373358 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a43d1eb-822b-4382-95fa-cbc617cb22fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:03:44.374092 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a43d1eb-822b-4382-95fa-cbc617cb22fc None admin] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:44.374389 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a43d1eb-822b-4382-95fa-cbc617cb22fc None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:44.374673 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a43d1eb-822b-4382-95fa-cbc617cb22fc None admin] PATH_INFO: `/v3/users` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:44.375388 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a43d1eb-822b-4382-95fa-cbc617cb22fc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:03:44.376843 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a43d1eb-822b-4382-95fa-cbc617cb22fc None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:03:44.389892 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 40/83] 10.222.0.136 () {58 vars in 1287 bytes} [Thu Jul 14 17:03:44 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 17:03:44.390737 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00be5feb-7f29-44f9-abe0-91c6090a9ad8 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:03:44.407674 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 44/84] 10.222.0.136 () {60 vars in 1137 bytes} [Thu Jul 14 17:03:44 2022] POST /identity/v3/users => generated 290 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 17:03:44.414584 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a43d1eb-822b-4382-95fa-cbc617cb22fc None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:03:44.508555 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00be5feb-7f29-44f9-abe0-91c6090a9ad8 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:03:44.529860 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a43d1eb-822b-4382-95fa-cbc617cb22fc None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:03:44.548551 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2ad49c-9dc0-435f-9670-185c0d8cea18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:03:44.549295 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2ad49c-9dc0-435f-9670-185c0d8cea18 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:44.549647 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2ad49c-9dc0-435f-9670-185c0d8cea18 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:44.549940 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2ad49c-9dc0-435f-9670-185c0d8cea18 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:44.558166 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:03:44.561658 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:03:44.571526 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae897a52-93a5-4ff3-9e9f-e0e21844cfbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:03:44.572211 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae897a52-93a5-4ff3-9e9f-e0e21844cfbc None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:44.572509 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae897a52-93a5-4ff3-9e9f-e0e21844cfbc None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:44.572803 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae897a52-93a5-4ff3-9e9f-e0e21844cfbc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:44.642026 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2ad49c-9dc0-435f-9670-185c0d8cea18 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:03:44.643556 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2ad49c-9dc0-435f-9670-185c0d8cea18 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:03:44.658709 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae897a52-93a5-4ff3-9e9f-e0e21844cfbc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:03:44.660504 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae897a52-93a5-4ff3-9e9f-e0e21844cfbc None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:03:44.786003 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 41/85] 10.222.0.136 () {58 vars in 1287 bytes} [Thu Jul 14 17:03:44 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 17:03:44.786853 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2ad49c-9dc0-435f-9670-185c0d8cea18 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:03:44.803739 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 45/86] 10.222.0.136 () {58 vars in 1287 bytes} [Thu Jul 14 17:03:44 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 17:03:44.805180 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae897a52-93a5-4ff3-9e9f-e0e21844cfbc None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:03:44.833105 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:03:44.843179 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:03:44.925168 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae897a52-93a5-4ff3-9e9f-e0e21844cfbc None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:03:44.931037 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2ad49c-9dc0-435f-9670-185c0d8cea18 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:03:44.966921 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d55437-2d98-46a5-868e-71b747521059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:03:44.968360 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d55437-2d98-46a5-868e-71b747521059 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:44.968733 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d55437-2d98-46a5-868e-71b747521059 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:44.969286 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d55437-2d98-46a5-868e-71b747521059 None admin] PATH_INFO: `/v3/projects/8bd70064655e4aa5832910aaa0dd0116` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:44.970809 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d55437-2d98-46a5-868e-71b747521059 None admin] RBAC: Authorizing `identity:get_project(project_id=8bd70064655e4aa5832910aaa0dd0116)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:03:44.973061 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d55437-2d98-46a5-868e-71b747521059 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:03:44.976379 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 46/87] 10.222.0.136 () {56 vars in 1191 bytes} [Thu Jul 14 17:03:44 2022] GET /identity/v3/projects/8bd70064655e4aa5832910aaa0dd0116 => generated 299 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:03:44.977627 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d55437-2d98-46a5-868e-71b747521059 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:03:44.981002 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f577b6-ad0b-4d4d-8bd5-084b349bebc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:03:44.983107 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f577b6-ad0b-4d4d-8bd5-084b349bebc5 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:44.983629 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f577b6-ad0b-4d4d-8bd5-084b349bebc5 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:44.984121 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f577b6-ad0b-4d4d-8bd5-084b349bebc5 None admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:44.985086 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f577b6-ad0b-4d4d-8bd5-084b349bebc5 None admin] RBAC: Adding query filter params (name=member) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:03:44.985722 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f577b6-ad0b-4d4d-8bd5-084b349bebc5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:03:44.987344 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f577b6-ad0b-4d4d-8bd5-084b349bebc5 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:03:44.999945 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 42/88] 10.222.0.136 () {56 vars in 1106 bytes} [Thu Jul 14 17:03:44 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:03:45.005030 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f577b6-ad0b-4d4d-8bd5-084b349bebc5 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:03:45.098640 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:03:45.111041 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d55437-2d98-46a5-868e-71b747521059 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:03:45.137430 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:03:45.142782 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f577b6-ad0b-4d4d-8bd5-084b349bebc5 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:03:45.156580 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e5165e-15a3-46c4-bbc1-742cb31206f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:03:45.157913 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e5165e-15a3-46c4-bbc1-742cb31206f3 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:45.158481 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e5165e-15a3-46c4-bbc1-742cb31206f3 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:45.158782 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e5165e-15a3-46c4-bbc1-742cb31206f3 None admin] PATH_INFO: `/v3/projects/8bd70064655e4aa5832910aaa0dd0116` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:45.160146 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e5165e-15a3-46c4-bbc1-742cb31206f3 None admin] RBAC: Authorizing `identity:get_project(project_id=8bd70064655e4aa5832910aaa0dd0116)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:03:45.162681 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e5165e-15a3-46c4-bbc1-742cb31206f3 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:03:45.165474 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 47/89] 10.222.0.136 () {56 vars in 1191 bytes} [Thu Jul 14 17:03:44 2022] GET /identity/v3/projects/8bd70064655e4aa5832910aaa0dd0116 => generated 299 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:03:45.166370 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e5165e-15a3-46c4-bbc1-742cb31206f3 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:03:45.185013 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7e817c-8ad3-4025-86d3-ce14069b45dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:03:45.186175 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7e817c-8ad3-4025-86d3-ce14069b45dc None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:45.186468 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7e817c-8ad3-4025-86d3-ce14069b45dc None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:45.187220 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7e817c-8ad3-4025-86d3-ce14069b45dc None admin] PATH_INFO: `/v3/projects/8bd70064655e4aa5832910aaa0dd0116` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:45.188686 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7e817c-8ad3-4025-86d3-ce14069b45dc None admin] RBAC: Authorizing `identity:get_project(project_id=8bd70064655e4aa5832910aaa0dd0116)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:03:45.190847 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7e817c-8ad3-4025-86d3-ce14069b45dc None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:03:45.192552 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 43/90] 10.222.0.136 () {56 vars in 1191 bytes} [Thu Jul 14 17:03:45 2022] GET /identity/v3/projects/8bd70064655e4aa5832910aaa0dd0116 => generated 299 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:03:45.193778 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7e817c-8ad3-4025-86d3-ce14069b45dc None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:03:45.302819 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e5165e-15a3-46c4-bbc1-742cb31206f3 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:03:45.329071 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7e817c-8ad3-4025-86d3-ce14069b45dc None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:03:45.348995 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a907815-ba1d-48b2-8708-e177b5223187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:03:45.349943 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a907815-ba1d-48b2-8708-e177b5223187 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:45.350449 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a907815-ba1d-48b2-8708-e177b5223187 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:45.351037 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a907815-ba1d-48b2-8708-e177b5223187 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:45.352909 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a907815-ba1d-48b2-8708-e177b5223187 None admin] RBAC: Adding query filter params (role.id=284c6314b4d3492085e397a87b0e3b51, scope.project.id=8bd70064655e4aa5832910aaa0dd0116, user.id=2178b080bea24cb2a1f6b50c1554ccd2) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:03:45.353495 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a907815-ba1d-48b2-8708-e177b5223187 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:03:45.355634 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a907815-ba1d-48b2-8708-e177b5223187 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:03:45.369576 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 48/91] 10.222.0.136 () {56 vars in 1379 bytes} [Thu Jul 14 17:03:45 2022] GET /identity/v3/role_assignments?user.id=2178b080bea24cb2a1f6b50c1554ccd2&scope.project.id=8bd70064655e4aa5832910aaa0dd0116&role.id=284c6314b4d3492085e397a87b0e3b51 => generated 260 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:03:45.369576 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a907815-ba1d-48b2-8708-e177b5223187 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:03:45.377478 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f45e70-5000-4725-af05-a035e4cd6013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:03:45.378409 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f45e70-5000-4725-af05-a035e4cd6013 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:45.378698 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f45e70-5000-4725-af05-a035e4cd6013 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:45.378981 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f45e70-5000-4725-af05-a035e4cd6013 None admin] PATH_INFO: `/v3/users/4a702add54724509bfb0e585a8aa4add` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:45.380597 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f45e70-5000-4725-af05-a035e4cd6013 None admin] RBAC: Authorizing `identity:get_user(user_id=4a702add54724509bfb0e585a8aa4add)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:03:45.386797 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f45e70-5000-4725-af05-a035e4cd6013 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:03:45.388680 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 44/92] 10.222.0.136 () {56 vars in 1182 bytes} [Thu Jul 14 17:03:45 2022] GET /identity/v3/users/4a702add54724509bfb0e585a8aa4add => generated 276 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:03:45.389504 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f45e70-5000-4725-af05-a035e4cd6013 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:03:45.423963 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:03:45.474187 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:03:45.552397 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f45e70-5000-4725-af05-a035e4cd6013 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:03:45.599550 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95e6dad-c27c-497b-b6f1-514e0155c831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:03:45.601198 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95e6dad-c27c-497b-b6f1-514e0155c831 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:45.601741 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95e6dad-c27c-497b-b6f1-514e0155c831 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:45.602220 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95e6dad-c27c-497b-b6f1-514e0155c831 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:45.603267 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95e6dad-c27c-497b-b6f1-514e0155c831 None admin] RBAC: Adding query filter params (role.id=5e321db416444dc9b5bfce7db763a7ed, scope.project.id=8bd70064655e4aa5832910aaa0dd0116, user.id=4a702add54724509bfb0e585a8aa4add) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:03:45.603813 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95e6dad-c27c-497b-b6f1-514e0155c831 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:03:45.605467 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95e6dad-c27c-497b-b6f1-514e0155c831 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:03:45.610975 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a907815-ba1d-48b2-8708-e177b5223187 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:03:45.620353 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 45/93] 10.222.0.136 () {56 vars in 1379 bytes} [Thu Jul 14 17:03:45 2022] GET /identity/v3/role_assignments?user.id=4a702add54724509bfb0e585a8aa4add&scope.project.id=8bd70064655e4aa5832910aaa0dd0116&role.id=5e321db416444dc9b5bfce7db763a7ed => generated 260 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:03:45.621492 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95e6dad-c27c-497b-b6f1-514e0155c831 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:03:45.682457 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee6508f-2e57-47fd-b958-de3459149f0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:03:45.683169 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee6508f-2e57-47fd-b958-de3459149f0e None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:45.683468 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee6508f-2e57-47fd-b958-de3459149f0e None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:45.683763 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee6508f-2e57-47fd-b958-de3459149f0e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:45.684621 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee6508f-2e57-47fd-b958-de3459149f0e None admin] RBAC: Adding query filter params (role.id=7441b1b1ab104537addd90a2471822f3, scope.project.id=8bd70064655e4aa5832910aaa0dd0116, user.id=4a702add54724509bfb0e585a8aa4add) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:03:45.684953 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee6508f-2e57-47fd-b958-de3459149f0e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:03:45.686474 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee6508f-2e57-47fd-b958-de3459149f0e None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:03:45.698145 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 49/94] 10.222.0.136 () {56 vars in 1379 bytes} [Thu Jul 14 17:03:45 2022] GET /identity/v3/role_assignments?user.id=4a702add54724509bfb0e585a8aa4add&scope.project.id=8bd70064655e4aa5832910aaa0dd0116&role.id=7441b1b1ab104537addd90a2471822f3 => generated 260 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:03:45.779880 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:03:45.788665 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95e6dad-c27c-497b-b6f1-514e0155c831 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:03:45.843460 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3333ca5-bbcd-43fe-8d35-97aa2b3a4a3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:03:45.844158 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3333ca5-bbcd-43fe-8d35-97aa2b3a4a3a None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:45.844458 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3333ca5-bbcd-43fe-8d35-97aa2b3a4a3a None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:45.844749 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3333ca5-bbcd-43fe-8d35-97aa2b3a4a3a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:45.935349 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3333ca5-bbcd-43fe-8d35-97aa2b3a4a3a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:03:45.936852 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3333ca5-bbcd-43fe-8d35-97aa2b3a4a3a None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:03:46.081755 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:03:46.089694 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 46/95] 10.222.0.136 () {58 vars in 1287 bytes} [Thu Jul 14 17:03:45 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 17:03:46.093012 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee6508f-2e57-47fd-b958-de3459149f0e None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:03:46.206293 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:03:46.219752 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee6508f-2e57-47fd-b958-de3459149f0e None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:03:46.260325 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40ac23f-37b7-4a56-9b76-5f0414184a19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:03:46.261212 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40ac23f-37b7-4a56-9b76-5f0414184a19 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:46.261504 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40ac23f-37b7-4a56-9b76-5f0414184a19 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:46.261826 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40ac23f-37b7-4a56-9b76-5f0414184a19 None admin] PATH_INFO: `/v3/projects/9c1720fc409d4e229c899e34dd0306c7` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:46.263068 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40ac23f-37b7-4a56-9b76-5f0414184a19 None admin] RBAC: Authorizing `identity:get_project(project_id=9c1720fc409d4e229c899e34dd0306c7)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:03:46.264630 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40ac23f-37b7-4a56-9b76-5f0414184a19 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:03:46.266536 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 50/96] 10.222.0.136 () {56 vars in 1191 bytes} [Thu Jul 14 17:03:46 2022] GET /identity/v3/projects/9c1720fc409d4e229c899e34dd0306c7 => generated 313 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:03:46.273180 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3333ca5-bbcd-43fe-8d35-97aa2b3a4a3a None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:03:46.407996 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3333ca5-bbcd-43fe-8d35-97aa2b3a4a3a None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:03:46.458395 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57fd593-76dc-40df-920f-bbc9f84b9a7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:03:46.458987 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57fd593-76dc-40df-920f-bbc9f84b9a7f None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:46.459283 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57fd593-76dc-40df-920f-bbc9f84b9a7f None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:46.459572 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57fd593-76dc-40df-920f-bbc9f84b9a7f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:46.462166 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57fd593-76dc-40df-920f-bbc9f84b9a7f None admin] RBAC: Adding query filter params (role.id=7441b1b1ab104537addd90a2471822f3, scope.project.id=9c1720fc409d4e229c899e34dd0306c7, user.id=4a702add54724509bfb0e585a8aa4add) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:03:46.462497 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57fd593-76dc-40df-920f-bbc9f84b9a7f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:03:46.464700 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57fd593-76dc-40df-920f-bbc9f84b9a7f None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:03:46.473341 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 47/97] 10.222.0.136 () {56 vars in 1379 bytes} [Thu Jul 14 17:03:46 2022] GET /identity/v3/role_assignments?user.id=4a702add54724509bfb0e585a8aa4add&scope.project.id=9c1720fc409d4e229c899e34dd0306c7&role.id=7441b1b1ab104537addd90a2471822f3 => generated 260 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:03:47.722363 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d3c22a-22a4-4956-aa50-fdafcdb3629f None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:47.722882 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d3c22a-22a4-4956-aa50-fdafcdb3629f None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:47.722956 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d3c22a-22a4-4956-aa50-fdafcdb3629f None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:47.724312 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 51/98] 10.222.0.136 () {54 vars in 931 bytes} [Thu Jul 14 17:03:47 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:03:47.730345 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805b0c5d-db87-4d64-8019-93ba942fdc20 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:47.730862 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805b0c5d-db87-4d64-8019-93ba942fdc20 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:47.730949 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805b0c5d-db87-4d64-8019-93ba942fdc20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:47.748632 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-805b0c5d-db87-4d64-8019-93ba942fdc20 None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:03:47.754040 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-805b0c5d-db87-4d64-8019-93ba942fdc20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:03:47.839078 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:03:47.848374 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 48/99] 10.222.0.136 () {58 vars in 1028 bytes} [Thu Jul 14 17:03:47 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 17:03:47.899466 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d3c22a-22a4-4956-aa50-fdafcdb3629f None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:03:47.954991 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ed13c9-5b5d-4638-aa56-bba3fb2127c8 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:47.955510 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ed13c9-5b5d-4638-aa56-bba3fb2127c8 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:47.955959 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ed13c9-5b5d-4638-aa56-bba3fb2127c8 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:47.960572 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 49/100] 10.222.0.136 () {54 vars in 931 bytes} [Thu Jul 14 17:03:47 2022] GET /identity => generated 271 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 14 17:03:47.966128 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a2e700-72c1-4d18-9c94-de656baa985a None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:47.966424 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a2e700-72c1-4d18-9c94-de656baa985a None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:47.969488 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a2e700-72c1-4d18-9c94-de656baa985a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:48.005188 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-d5a2e700-72c1-4d18-9c94-de656baa985a None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:03:48.006337 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-d5a2e700-72c1-4d18-9c94-de656baa985a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:03:48.078237 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d3c22a-22a4-4956-aa50-fdafcdb3629f None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:03:48.108522 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 50/101] 10.222.0.136 () {58 vars in 1028 bytes} [Thu Jul 14 17:03:47 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 17:03:48.110312 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cd6747-094c-4418-b7ca-b6c71c93f5d4 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:48.110839 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cd6747-094c-4418-b7ca-b6c71c93f5d4 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:48.111545 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cd6747-094c-4418-b7ca-b6c71c93f5d4 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:48.113050 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 51/102] 10.222.0.136 () {54 vars in 931 bytes} [Thu Jul 14 17:03:48 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:03:48.119379 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47594811-fe6d-4284-993d-a1b2476d6214 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:48.120087 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47594811-fe6d-4284-993d-a1b2476d6214 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:48.120574 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47594811-fe6d-4284-993d-a1b2476d6214 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:48.155254 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-47594811-fe6d-4284-993d-a1b2476d6214 None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:03:48.156896 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-47594811-fe6d-4284-993d-a1b2476d6214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:03:48.164496 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3550d7b2-742c-4907-ac9e-565c7a8281f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:03:48.165740 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3550d7b2-742c-4907-ac9e-565c7a8281f4 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:48.166032 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3550d7b2-742c-4907-ac9e-565c7a8281f4 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:48.166319 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3550d7b2-742c-4907-ac9e-565c7a8281f4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:48.202216 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3550d7b2-742c-4907-ac9e-565c7a8281f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 17:03:48.210801 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-3550d7b2-742c-4907-ac9e-565c7a8281f4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 17:03:48.210801 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:03:48.210801 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:03:48.210801 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:03:48.210801 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:03:48.210801 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:03:48.210801 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:03:48.210801 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:03:48.210801 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:03:48.210801 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:03:48.210801 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:03:48.210801 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:03:48.210801 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 17:03:48.210801 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 17:03:48.210801 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 17:03:48.210801 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 17:03:48.211735 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 17:03:48.211735 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 17:03:48.211735 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 17:03:48.211735 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 17:03:48.211735 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:03:48.211735 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:03:48.211735 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:03:48.211735 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:03:48.211735 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:03:48.211735 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:03:48.211735 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:03:48.211735 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Jul 14 17:03:48.211735 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:03:48.211735 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:03:48.211735 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:03:48.211735 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:03:48.212535 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:03:48.212535 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:03:48.212535 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:03:48.212535 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:03:48.212535 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 17:03:48.212535 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 17:03:48.212535 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 17:03:48.212535 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 17:03:48.212535 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 17:03:48.212535 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 17:03:48.212535 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 17:03:48.212535 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Jul 14 17:03:48.219839 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 52/103] 10.222.0.136 () {56 vars in 1104 bytes} [Thu Jul 14 17:03:47 2022] GET /identity/v3/roles/reader => generated 84 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 17:03:48.220924 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3550d7b2-742c-4907-ac9e-565c7a8281f4 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:03:48.256704 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:03:48.275390 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 52/104] 10.222.0.136 () {58 vars in 1028 bytes} [Thu Jul 14 17:03:48 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 17:03:48.278166 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47594811-fe6d-4284-993d-a1b2476d6214 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:03:48.353804 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:03:48.404326 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47594811-fe6d-4284-993d-a1b2476d6214 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:03:48.444089 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d70e87a-bde8-4ca1-9284-8d93c933f5f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:03:48.445283 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d70e87a-bde8-4ca1-9284-8d93c933f5f0 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:48.445841 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d70e87a-bde8-4ca1-9284-8d93c933f5f0 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:48.446403 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d70e87a-bde8-4ca1-9284-8d93c933f5f0 None admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:48.447516 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d70e87a-bde8-4ca1-9284-8d93c933f5f0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:03:48.448083 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d70e87a-bde8-4ca1-9284-8d93c933f5f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:03:48.449986 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d70e87a-bde8-4ca1-9284-8d93c933f5f0 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:03:48.459354 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 53/105] 10.222.0.136 () {56 vars in 1106 bytes} [Thu Jul 14 17:03:48 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:03:48.461141 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d70e87a-bde8-4ca1-9284-8d93c933f5f0 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:03:48.483953 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3550d7b2-742c-4907-ac9e-565c7a8281f4 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:03:48.582025 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d70e87a-bde8-4ca1-9284-8d93c933f5f0 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:03:48.594322 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e27b1d9-cce4-44ff-8d87-3881334342db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:03:48.595155 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e27b1d9-cce4-44ff-8d87-3881334342db None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:48.595769 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e27b1d9-cce4-44ff-8d87-3881334342db None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:48.595769 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e27b1d9-cce4-44ff-8d87-3881334342db None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:48.604860 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:03:48.625574 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9868a5-4337-4123-85f4-065381a4c16e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:03:48.626460 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e27b1d9-cce4-44ff-8d87-3881334342db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 17:03:48.626900 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9868a5-4337-4123-85f4-065381a4c16e None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:48.627361 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9868a5-4337-4123-85f4-065381a4c16e None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:48.627830 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9868a5-4337-4123-85f4-065381a4c16e None admin] PATH_INFO: `/v3/domains/default` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:48.629244 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9868a5-4337-4123-85f4-065381a4c16e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:03:48.630950 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9868a5-4337-4123-85f4-065381a4c16e None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:03:48.637894 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 54/106] 10.222.0.136 () {56 vars in 1113 bytes} [Thu Jul 14 17:03:48 2022] GET /identity/v3/domains/default => generated 200 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:03:48.638969 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9868a5-4337-4123-85f4-065381a4c16e None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:03:48.639146 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-9e27b1d9-cce4-44ff-8d87-3881334342db None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 17:03:48.639146 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:03:48.639146 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:03:48.639146 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:03:48.639146 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:03:48.639146 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:03:48.639146 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:03:48.639146 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:03:48.639146 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:03:48.639146 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:03:48.639146 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:03:48.639146 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:03:48.639146 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 17:03:48.639146 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 17:03:48.639146 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 17:03:48.639146 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 17:03:48.639971 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 17:03:48.639971 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 17:03:48.639971 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 17:03:48.639971 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 17:03:48.639971 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:03:48.639971 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:03:48.639971 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:03:48.639971 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:03:48.639971 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:03:48.639971 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:03:48.639971 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:03:48.639971 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Jul 14 17:03:48.639971 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:03:48.639971 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:03:48.639971 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:03:48.639971 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:03:48.640739 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:03:48.640739 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:03:48.640739 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:03:48.640739 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:03:48.640739 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 17:03:48.640739 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 17:03:48.640739 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 17:03:48.640739 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 17:03:48.640739 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 17:03:48.640739 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 17:03:48.640739 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 17:03:48.640739 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Jul 14 17:03:48.645415 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 53/107] 10.222.0.136 () {56 vars in 1101 bytes} [Thu Jul 14 17:03:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 420 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:03:48.650514 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e27b1d9-cce4-44ff-8d87-3881334342db None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:03:48.756508 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9868a5-4337-4123-85f4-065381a4c16e None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:03:48.782343 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:03:48.797442 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03207cd2-54ca-4bf9-9d85-53fc9a9e288d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:03:48.798459 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03207cd2-54ca-4bf9-9d85-53fc9a9e288d None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:48.798758 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03207cd2-54ca-4bf9-9d85-53fc9a9e288d None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:48.799045 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03207cd2-54ca-4bf9-9d85-53fc9a9e288d None admin] PATH_INFO: `/v3/users/c9fe1d1ff8a24ae28a4a1fc8085a85a1` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:48.807311 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e27b1d9-cce4-44ff-8d87-3881334342db None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:03:48.815026 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03207cd2-54ca-4bf9-9d85-53fc9a9e288d None admin] RBAC: Authorizing `identity:get_user(user_id=c9fe1d1ff8a24ae28a4a1fc8085a85a1)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:03:48.816618 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03207cd2-54ca-4bf9-9d85-53fc9a9e288d None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:03:48.823463 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 55/108] 10.222.0.136 () {56 vars in 1182 bytes} [Thu Jul 14 17:03:48 2022] GET /identity/v3/users/c9fe1d1ff8a24ae28a4a1fc8085a85a1 => generated 290 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:03:48.824419 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03207cd2-54ca-4bf9-9d85-53fc9a9e288d None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:03:48.842513 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2957310-0927-45c5-bc8b-c08a301cae3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:03:48.843117 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2957310-0927-45c5-bc8b-c08a301cae3a None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:48.843410 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2957310-0927-45c5-bc8b-c08a301cae3a None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:48.843693 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2957310-0927-45c5-bc8b-c08a301cae3a None admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:48.844443 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2957310-0927-45c5-bc8b-c08a301cae3a None admin] RBAC: Adding query filter params (name=admin) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:03:48.844757 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2957310-0927-45c5-bc8b-c08a301cae3a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:03:48.846183 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2957310-0927-45c5-bc8b-c08a301cae3a None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:03:48.855936 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 54/109] 10.222.0.136 () {56 vars in 1104 bytes} [Thu Jul 14 17:03:48 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:03:48.857703 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9041fa4-92c9-4416-b4d4-619ac3994933 None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:48.858055 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9041fa4-92c9-4416-b4d4-619ac3994933 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:48.858342 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9041fa4-92c9-4416-b4d4-619ac3994933 None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:48.859571 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 55/110] 10.222.0.136 () {54 vars in 931 bytes} [Thu Jul 14 17:03:48 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:03:48.860343 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9041fa4-92c9-4416-b4d4-619ac3994933 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:03:48.879264 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:03:48.946216 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03207cd2-54ca-4bf9-9d85-53fc9a9e288d None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:03:48.969893 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9041fa4-92c9-4416-b4d4-619ac3994933 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:03:48.985577 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8a320c-0112-402a-bcf0-ff972f3244f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:03:48.986529 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8a320c-0112-402a-bcf0-ff972f3244f1 None admin] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:48.987424 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8a320c-0112-402a-bcf0-ff972f3244f1 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:48.987424 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8a320c-0112-402a-bcf0-ff972f3244f1 None admin] PATH_INFO: `/v3/projects` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:48.987879 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8a320c-0112-402a-bcf0-ff972f3244f1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:03:48.989763 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8a320c-0112-402a-bcf0-ff972f3244f1 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:03:49.014096 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4f9957-63e7-487c-84ad-3abad6de3708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:03:49.014810 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4f9957-63e7-487c-84ad-3abad6de3708 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:49.015106 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4f9957-63e7-487c-84ad-3abad6de3708 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:49.015623 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4f9957-63e7-487c-84ad-3abad6de3708 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:49.023179 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 56/111] 10.222.0.136 () {60 vars in 1146 bytes} [Thu Jul 14 17:03:48 2022] POST /identity/v3/projects => generated 303 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 17:03:49.024218 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8a320c-0112-402a-bcf0-ff972f3244f1 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:03:49.026287 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:03:49.101076 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4f9957-63e7-487c-84ad-3abad6de3708 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:03:49.102694 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4f9957-63e7-487c-84ad-3abad6de3708 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:03:49.141999 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:03:49.152714 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8a320c-0112-402a-bcf0-ff972f3244f1 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:03:49.196796 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cc0551-9951-4ed9-9df0-8dd54cbb6228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:03:49.198145 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cc0551-9951-4ed9-9df0-8dd54cbb6228 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:49.198741 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cc0551-9951-4ed9-9df0-8dd54cbb6228 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:49.199251 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cc0551-9951-4ed9-9df0-8dd54cbb6228 None admin] PATH_INFO: `/v3/users/2178b080bea24cb2a1f6b50c1554ccd2` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:49.200867 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cc0551-9951-4ed9-9df0-8dd54cbb6228 None admin] RBAC: Authorizing `identity:get_user(user_id=2178b080bea24cb2a1f6b50c1554ccd2)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:03:49.202935 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cc0551-9951-4ed9-9df0-8dd54cbb6228 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:03:49.205347 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 57/112] 10.222.0.136 () {56 vars in 1182 bytes} [Thu Jul 14 17:03:49 2022] GET /identity/v3/users/2178b080bea24cb2a1f6b50c1554ccd2 => generated 248 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:03:49.207012 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db3f1f0-a089-4542-b5dc-791718558401 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:49.207514 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db3f1f0-a089-4542-b5dc-791718558401 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:49.208218 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db3f1f0-a089-4542-b5dc-791718558401 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:49.230144 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-4db3f1f0-a089-4542-b5dc-791718558401 None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:03:49.232145 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-4db3f1f0-a089-4542-b5dc-791718558401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:03:49.239522 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 56/113] 10.222.0.136 () {58 vars in 1287 bytes} [Thu Jul 14 17:03:48 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 17:03:49.245570 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4f9957-63e7-487c-84ad-3abad6de3708 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:03:49.312734 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:03:49.324852 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 58/114] 10.222.0.136 () {58 vars in 1028 bytes} [Thu Jul 14 17:03:49 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 17:03:49.330329 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db3f1f0-a089-4542-b5dc-791718558401 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:03:49.388576 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4f9957-63e7-487c-84ad-3abad6de3708 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:03:49.429914 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5bf08f-3c02-44c7-9876-085275d94432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:03:49.430802 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5bf08f-3c02-44c7-9876-085275d94432 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:49.431126 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5bf08f-3c02-44c7-9876-085275d94432 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:49.431381 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5bf08f-3c02-44c7-9876-085275d94432 None admin] PATH_INFO: `/v3/projects/8bd70064655e4aa5832910aaa0dd0116` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:49.432609 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5bf08f-3c02-44c7-9876-085275d94432 None admin] RBAC: Authorizing `identity:get_project(project_id=8bd70064655e4aa5832910aaa0dd0116)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:03:49.434123 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5bf08f-3c02-44c7-9876-085275d94432 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:03:49.436160 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 57/115] 10.222.0.136 () {56 vars in 1191 bytes} [Thu Jul 14 17:03:49 2022] GET /identity/v3/projects/8bd70064655e4aa5832910aaa0dd0116 => generated 299 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:03:49.437388 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c9fe4c-6fcc-4e65-8e6d-0dedb25ded25 None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:49.437731 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c9fe4c-6fcc-4e65-8e6d-0dedb25ded25 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:49.438020 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c9fe4c-6fcc-4e65-8e6d-0dedb25ded25 None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:49.439264 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 58/116] 10.222.0.136 () {54 vars in 931 bytes} [Thu Jul 14 17:03:49 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:03:49.439966 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c9fe4c-6fcc-4e65-8e6d-0dedb25ded25 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:03:49.460997 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:03:49.473151 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db3f1f0-a089-4542-b5dc-791718558401 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:03:49.525582 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6167f38-15d3-4db9-b20f-813f7b82bd2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:03:49.527424 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6167f38-15d3-4db9-b20f-813f7b82bd2d None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:49.527942 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6167f38-15d3-4db9-b20f-813f7b82bd2d None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:49.528423 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6167f38-15d3-4db9-b20f-813f7b82bd2d None admin] PATH_INFO: `/v3/projects/8bd70064655e4aa5832910aaa0dd0116` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:49.530808 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6167f38-15d3-4db9-b20f-813f7b82bd2d None admin] RBAC: Authorizing `identity:get_project(project_id=8bd70064655e4aa5832910aaa0dd0116)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:03:49.533147 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6167f38-15d3-4db9-b20f-813f7b82bd2d None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:03:49.535883 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 59/117] 10.222.0.136 () {56 vars in 1191 bytes} [Thu Jul 14 17:03:49 2022] GET /identity/v3/projects/8bd70064655e4aa5832910aaa0dd0116 => generated 299 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:03:49.541865 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326274d3-b2a3-43e8-8398-7a0da75f6086 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:49.541865 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326274d3-b2a3-43e8-8398-7a0da75f6086 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:49.541865 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326274d3-b2a3-43e8-8398-7a0da75f6086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:49.559989 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c9fe4c-6fcc-4e65-8e6d-0dedb25ded25 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:03:49.566389 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-326274d3-b2a3-43e8-8398-7a0da75f6086 None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:03:49.568487 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:03:49.569966 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-326274d3-b2a3-43e8-8398-7a0da75f6086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:03:49.602367 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53210dbc-8e6d-4c7d-8dae-04d1e727e3b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:03:49.603584 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53210dbc-8e6d-4c7d-8dae-04d1e727e3b3 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:49.603584 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53210dbc-8e6d-4c7d-8dae-04d1e727e3b3 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:49.603858 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53210dbc-8e6d-4c7d-8dae-04d1e727e3b3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:49.616175 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53210dbc-8e6d-4c7d-8dae-04d1e727e3b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 17:03:49.624540 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-53210dbc-8e6d-4c7d-8dae-04d1e727e3b3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 17:03:49.624540 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:03:49.624540 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:03:49.624540 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:03:49.624540 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:03:49.624540 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:03:49.624540 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:03:49.624540 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:03:49.624540 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:03:49.624540 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:03:49.624540 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:03:49.624540 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:03:49.624540 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 17:03:49.624540 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 17:03:49.624540 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 17:03:49.624540 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 17:03:49.625456 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 17:03:49.625456 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 17:03:49.625456 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 17:03:49.625456 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 17:03:49.625456 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:03:49.625456 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:03:49.625456 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:03:49.625456 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:03:49.625456 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:03:49.625456 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:03:49.625456 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:03:49.625456 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Jul 14 17:03:49.625456 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:03:49.625456 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:03:49.625456 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:03:49.625456 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:03:49.626240 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:03:49.626240 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:03:49.626240 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:03:49.626240 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:03:49.626240 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 17:03:49.626240 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 17:03:49.626240 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 17:03:49.626240 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 17:03:49.626240 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 17:03:49.626240 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 17:03:49.626240 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 17:03:49.626240 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Jul 14 17:03:49.630877 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 59/118] 10.222.0.136 () {56 vars in 1119 bytes} [Thu Jul 14 17:03:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:03:49.632135 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53210dbc-8e6d-4c7d-8dae-04d1e727e3b3 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:03:49.670459 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 60/119] 10.222.0.136 () {58 vars in 1028 bytes} [Thu Jul 14 17:03:49 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 17:03:49.672613 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326274d3-b2a3-43e8-8398-7a0da75f6086 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:03:49.754602 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53210dbc-8e6d-4c7d-8dae-04d1e727e3b3 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:03:49.794818 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d9a8cd-1374-4c88-8e4c-b4b635f607a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:03:49.795693 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d9a8cd-1374-4c88-8e4c-b4b635f607a3 None admin] REQUEST_METHOD: `PUT` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:49.795991 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d9a8cd-1374-4c88-8e4c-b4b635f607a3 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:49.796281 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d9a8cd-1374-4c88-8e4c-b4b635f607a3 None admin] PATH_INFO: `/v3/projects/8bd70064655e4aa5832910aaa0dd0116/users/2178b080bea24cb2a1f6b50c1554ccd2/roles/284c6314b4d3492085e397a87b0e3b51` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:49.798393 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d9a8cd-1374-4c88-8e4c-b4b635f607a3 None admin] RBAC: Authorizing `identity:create_grant(project_id=8bd70064655e4aa5832910aaa0dd0116, user_id=2178b080bea24cb2a1f6b50c1554ccd2, role_id=284c6314b4d3492085e397a87b0e3b51)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:03:49.800082 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d9a8cd-1374-4c88-8e4c-b4b635f607a3 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:03:49.808134 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:03:49.818422 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 60/120] 10.222.0.136 () {58 vars in 1444 bytes} [Thu Jul 14 17:03:49 2022] PUT /identity/v3/projects/8bd70064655e4aa5832910aaa0dd0116/users/2178b080bea24cb2a1f6b50c1554ccd2/roles/284c6314b4d3492085e397a87b0e3b51 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:03:49.819851 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d9a8cd-1374-4c88-8e4c-b4b635f607a3 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:03:49.825123 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326274d3-b2a3-43e8-8398-7a0da75f6086 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:03:49.853367 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:03:49.880025 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf70d02c-98af-44e1-a5c1-2d577aac8254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:03:49.881237 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf70d02c-98af-44e1-a5c1-2d577aac8254 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:49.882734 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf70d02c-98af-44e1-a5c1-2d577aac8254 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:49.883130 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf70d02c-98af-44e1-a5c1-2d577aac8254 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:49.884402 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf70d02c-98af-44e1-a5c1-2d577aac8254 None admin] RBAC: Adding query filter params (role.id=2df0ddb31c5141c496d5705ff0dd2bc0, scope.project.id=8bd70064655e4aa5832910aaa0dd0116, user.id=c9fe1d1ff8a24ae28a4a1fc8085a85a1) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:03:49.884821 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf70d02c-98af-44e1-a5c1-2d577aac8254 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:03:49.887214 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf70d02c-98af-44e1-a5c1-2d577aac8254 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:03:49.896462 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 61/121] 10.222.0.136 () {56 vars in 1379 bytes} [Thu Jul 14 17:03:49 2022] GET /identity/v3/role_assignments?user.id=c9fe1d1ff8a24ae28a4a1fc8085a85a1&scope.project.id=8bd70064655e4aa5832910aaa0dd0116&role.id=2df0ddb31c5141c496d5705ff0dd2bc0 => generated 260 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:03:49.898310 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf70d02c-98af-44e1-a5c1-2d577aac8254 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:03:50.039590 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d9a8cd-1374-4c88-8e4c-b4b635f607a3 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:03:50.069942 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf70d02c-98af-44e1-a5c1-2d577aac8254 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:03:50.103570 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dd04ae-6c86-4c9a-adfb-636557c84f0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:03:50.104265 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dd04ae-6c86-4c9a-adfb-636557c84f0d None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:50.104558 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dd04ae-6c86-4c9a-adfb-636557c84f0d None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:50.104842 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dd04ae-6c86-4c9a-adfb-636557c84f0d None admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:50.105625 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dd04ae-6c86-4c9a-adfb-636557c84f0d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:03:50.105942 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dd04ae-6c86-4c9a-adfb-636557c84f0d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:03:50.107629 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dd04ae-6c86-4c9a-adfb-636557c84f0d None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:03:50.112996 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf44cace-0784-42e5-94cc-61e7173ffe55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:03:50.113970 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf44cace-0784-42e5-94cc-61e7173ffe55 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:50.114262 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf44cace-0784-42e5-94cc-61e7173ffe55 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:50.114596 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf44cace-0784-42e5-94cc-61e7173ffe55 None admin] PATH_INFO: `/v3/roles/member` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:50.116941 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 61/122] 10.222.0.136 () {56 vars in 1116 bytes} [Thu Jul 14 17:03:49 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:03:50.118382 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c2c9d4-9949-4d3a-924d-2feabb2dbf5e None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:50.118683 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c2c9d4-9949-4d3a-924d-2feabb2dbf5e None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:50.118971 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c2c9d4-9949-4d3a-924d-2feabb2dbf5e None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:50.120214 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 62/123] 10.222.0.136 () {54 vars in 931 bytes} [Thu Jul 14 17:03:50 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:03:50.125002 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c2c9d4-9949-4d3a-924d-2feabb2dbf5e None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:03:50.128108 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf44cace-0784-42e5-94cc-61e7173ffe55 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 17:03:50.137282 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-cf44cace-0784-42e5-94cc-61e7173ffe55 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 17:03:50.137282 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:03:50.137282 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:03:50.137282 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:03:50.137282 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:03:50.137282 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:03:50.137282 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:03:50.137282 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:03:50.137282 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:03:50.137282 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:03:50.137282 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:03:50.137282 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:03:50.137282 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 17:03:50.137282 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 17:03:50.137282 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 17:03:50.137282 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 17:03:50.138258 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 17:03:50.138258 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 17:03:50.138258 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 17:03:50.138258 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 17:03:50.138258 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:03:50.138258 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:03:50.138258 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:03:50.138258 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:03:50.138258 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:03:50.138258 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:03:50.138258 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:03:50.138258 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Jul 14 17:03:50.138258 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:03:50.138258 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:03:50.138258 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:03:50.138258 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:03:50.139024 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:03:50.139024 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:03:50.139024 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:03:50.139024 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:03:50.139024 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 17:03:50.139024 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 17:03:50.139024 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 17:03:50.139024 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 17:03:50.139024 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 17:03:50.139024 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 17:03:50.139024 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 17:03:50.139024 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Jul 14 17:03:50.139024 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 62/124] 10.222.0.136 () {56 vars in 1104 bytes} [Thu Jul 14 17:03:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:03:50.140525 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be09aa41-a50d-4d17-a65f-ecf90f23b465 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:50.140697 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be09aa41-a50d-4d17-a65f-ecf90f23b465 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:50.140836 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be09aa41-a50d-4d17-a65f-ecf90f23b465 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:50.160162 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-be09aa41-a50d-4d17-a65f-ecf90f23b465 None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:03:50.161904 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-be09aa41-a50d-4d17-a65f-ecf90f23b465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:03:50.174899 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:03:50.237107 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:03:50.247022 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 63/125] 10.222.0.136 () {58 vars in 1028 bytes} [Thu Jul 14 17:03:50 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 17:03:50.248088 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be09aa41-a50d-4d17-a65f-ecf90f23b465 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:03:50.261518 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c2c9d4-9949-4d3a-924d-2feabb2dbf5e None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:03:50.320077 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f0834f-ac8a-4121-8d9b-7183e3b91cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:03:50.320828 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f0834f-ac8a-4121-8d9b-7183e3b91cb8 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:50.329037 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f0834f-ac8a-4121-8d9b-7183e3b91cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:50.329037 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f0834f-ac8a-4121-8d9b-7183e3b91cb8 None admin] PATH_INFO: `/v3/users/4a702add54724509bfb0e585a8aa4add` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:50.334450 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f0834f-ac8a-4121-8d9b-7183e3b91cb8 None admin] RBAC: Authorizing `identity:get_user(user_id=4a702add54724509bfb0e585a8aa4add)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:03:50.335975 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f0834f-ac8a-4121-8d9b-7183e3b91cb8 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:03:50.337738 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 63/126] 10.222.0.136 () {56 vars in 1182 bytes} [Thu Jul 14 17:03:50 2022] GET /identity/v3/users/4a702add54724509bfb0e585a8aa4add => generated 276 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:03:50.338515 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f0834f-ac8a-4121-8d9b-7183e3b91cb8 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:03:50.361436 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be09aa41-a50d-4d17-a65f-ecf90f23b465 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:03:50.399033 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ef7112-5e61-403f-9e85-9f0f88b4212d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:03:50.399716 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ef7112-5e61-403f-9e85-9f0f88b4212d None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:50.400003 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ef7112-5e61-403f-9e85-9f0f88b4212d None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:50.400285 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ef7112-5e61-403f-9e85-9f0f88b4212d None admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:50.401033 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ef7112-5e61-403f-9e85-9f0f88b4212d None admin] RBAC: Adding query filter params (name=member) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:03:50.401346 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ef7112-5e61-403f-9e85-9f0f88b4212d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:03:50.402851 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ef7112-5e61-403f-9e85-9f0f88b4212d None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:03:50.411950 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 64/127] 10.222.0.136 () {56 vars in 1106 bytes} [Thu Jul 14 17:03:50 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:03:50.413567 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ef7112-5e61-403f-9e85-9f0f88b4212d None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:03:50.444273 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:03:50.543514 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f0834f-ac8a-4121-8d9b-7183e3b91cb8 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:03:50.571683 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ef7112-5e61-403f-9e85-9f0f88b4212d None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:03:50.617033 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a1d9a3-240d-4811-a175-7541566021ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:03:50.617509 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a1d9a3-240d-4811-a175-7541566021ab None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:50.617824 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a1d9a3-240d-4811-a175-7541566021ab None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:50.618157 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a1d9a3-240d-4811-a175-7541566021ab None admin] PATH_INFO: `/v3/projects/8bd70064655e4aa5832910aaa0dd0116` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:50.619416 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a1d9a3-240d-4811-a175-7541566021ab None admin] RBAC: Authorizing `identity:get_project(project_id=8bd70064655e4aa5832910aaa0dd0116)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:03:50.620944 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a1d9a3-240d-4811-a175-7541566021ab None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:03:50.622612 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 65/128] 10.222.0.136 () {56 vars in 1191 bytes} [Thu Jul 14 17:03:50 2022] GET /identity/v3/projects/8bd70064655e4aa5832910aaa0dd0116 => generated 299 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:03:50.623384 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a1d9a3-240d-4811-a175-7541566021ab None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:03:50.624911 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14edeb5b-ab97-4c92-934f-c7afb999d083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:03:50.625754 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14edeb5b-ab97-4c92-934f-c7afb999d083 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:50.626043 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14edeb5b-ab97-4c92-934f-c7afb999d083 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:50.626326 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14edeb5b-ab97-4c92-934f-c7afb999d083 None admin] PATH_INFO: `/v3/roles/member` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:50.652717 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14edeb5b-ab97-4c92-934f-c7afb999d083 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 17:03:50.660871 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-14edeb5b-ab97-4c92-934f-c7afb999d083 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 17:03:50.660871 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:03:50.660871 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:03:50.660871 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:03:50.660871 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:03:50.660871 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:03:50.660871 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:03:50.660871 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:03:50.660871 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:03:50.660871 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:03:50.660871 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:03:50.660871 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:03:50.660871 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 17:03:50.660871 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 17:03:50.660871 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 17:03:50.660871 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 17:03:50.661995 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 17:03:50.661995 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 17:03:50.661995 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 17:03:50.661995 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 17:03:50.661995 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:03:50.661995 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:03:50.661995 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:03:50.661995 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:03:50.661995 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:03:50.661995 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:03:50.661995 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:03:50.661995 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Jul 14 17:03:50.661995 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:03:50.661995 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:03:50.661995 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:03:50.661995 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:03:50.663032 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:03:50.663032 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:03:50.663032 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:03:50.663032 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:03:50.663032 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 17:03:50.663032 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 17:03:50.663032 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 17:03:50.663032 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 17:03:50.663032 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 17:03:50.663032 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 17:03:50.663032 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 17:03:50.663032 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Jul 14 17:03:50.663032 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 64/129] 10.222.0.136 () {56 vars in 1104 bytes} [Thu Jul 14 17:03:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:03:50.663749 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14edeb5b-ab97-4c92-934f-c7afb999d083 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:03:50.684204 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:03:50.753925 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:03:50.774500 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a1d9a3-240d-4811-a175-7541566021ab None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:03:50.814920 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d36ecd1-c34a-4f17-a595-c7284632d213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:03:50.816035 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d36ecd1-c34a-4f17-a595-c7284632d213 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:50.816392 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d36ecd1-c34a-4f17-a595-c7284632d213 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:50.816741 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d36ecd1-c34a-4f17-a595-c7284632d213 None admin] PATH_INFO: `/v3/users/4a702add54724509bfb0e585a8aa4add` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:50.818066 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d36ecd1-c34a-4f17-a595-c7284632d213 None admin] RBAC: Authorizing `identity:get_user(user_id=4a702add54724509bfb0e585a8aa4add)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:03:50.821049 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d36ecd1-c34a-4f17-a595-c7284632d213 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:03:50.823026 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 66/130] 10.222.0.136 () {56 vars in 1182 bytes} [Thu Jul 14 17:03:50 2022] GET /identity/v3/users/4a702add54724509bfb0e585a8aa4add => generated 276 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:03:50.823742 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d36ecd1-c34a-4f17-a595-c7284632d213 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:03:50.875372 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14edeb5b-ab97-4c92-934f-c7afb999d083 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:03:50.971056 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d36ecd1-c34a-4f17-a595-c7284632d213 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:03:50.986676 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c60cec-9aed-4b59-b54d-71a3bce49023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:03:50.987976 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c60cec-9aed-4b59-b54d-71a3bce49023 None admin] REQUEST_METHOD: `PUT` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:50.988265 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c60cec-9aed-4b59-b54d-71a3bce49023 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:50.988548 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c60cec-9aed-4b59-b54d-71a3bce49023 None admin] PATH_INFO: `/v3/projects/8bd70064655e4aa5832910aaa0dd0116/users/4a702add54724509bfb0e585a8aa4add/roles/5e321db416444dc9b5bfce7db763a7ed` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:50.993482 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c60cec-9aed-4b59-b54d-71a3bce49023 None admin] RBAC: Authorizing `identity:create_grant(project_id=8bd70064655e4aa5832910aaa0dd0116, user_id=4a702add54724509bfb0e585a8aa4add, role_id=5e321db416444dc9b5bfce7db763a7ed)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:03:50.995024 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c60cec-9aed-4b59-b54d-71a3bce49023 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:03:51.021011 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 65/131] 10.222.0.136 () {58 vars in 1444 bytes} [Thu Jul 14 17:03:50 2022] PUT /identity/v3/projects/8bd70064655e4aa5832910aaa0dd0116/users/4a702add54724509bfb0e585a8aa4add/roles/5e321db416444dc9b5bfce7db763a7ed => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:03:51.022204 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c60cec-9aed-4b59-b54d-71a3bce49023 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:03:51.046651 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24affe49-abdf-46eb-a98c-1f5610e48689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:03:51.047369 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24affe49-abdf-46eb-a98c-1f5610e48689 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:51.047660 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24affe49-abdf-46eb-a98c-1f5610e48689 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:51.047947 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24affe49-abdf-46eb-a98c-1f5610e48689 None admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:51.048728 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24affe49-abdf-46eb-a98c-1f5610e48689 None admin] RBAC: Adding query filter params (name=member) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:03:51.049045 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24affe49-abdf-46eb-a98c-1f5610e48689 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:03:51.050525 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24affe49-abdf-46eb-a98c-1f5610e48689 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:03:51.070566 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 67/132] 10.222.0.136 () {56 vars in 1106 bytes} [Thu Jul 14 17:03:50 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:03:51.080493 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24affe49-abdf-46eb-a98c-1f5610e48689 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:03:51.088225 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:03:51.164064 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:03:51.205039 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c60cec-9aed-4b59-b54d-71a3bce49023 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:03:51.284076 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5bfb64-7516-43f2-82d4-a38c91a65446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:03:51.284629 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5bfb64-7516-43f2-82d4-a38c91a65446 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:51.284928 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5bfb64-7516-43f2-82d4-a38c91a65446 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:51.285447 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5bfb64-7516-43f2-82d4-a38c91a65446 None admin] PATH_INFO: `/v3/projects/8bd70064655e4aa5832910aaa0dd0116` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:51.286718 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5bfb64-7516-43f2-82d4-a38c91a65446 None admin] RBAC: Authorizing `identity:get_project(project_id=8bd70064655e4aa5832910aaa0dd0116)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:03:51.288594 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5bfb64-7516-43f2-82d4-a38c91a65446 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:03:51.290629 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 66/133] 10.222.0.136 () {56 vars in 1191 bytes} [Thu Jul 14 17:03:51 2022] GET /identity/v3/projects/8bd70064655e4aa5832910aaa0dd0116 => generated 299 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:03:51.298613 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5bfb64-7516-43f2-82d4-a38c91a65446 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:03:51.357428 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24affe49-abdf-46eb-a98c-1f5610e48689 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:03:51.434458 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8781dc49-bede-4a25-a1bd-87af71f8d76d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:03:51.435349 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8781dc49-bede-4a25-a1bd-87af71f8d76d None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:51.435637 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8781dc49-bede-4a25-a1bd-87af71f8d76d None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:51.435914 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8781dc49-bede-4a25-a1bd-87af71f8d76d None admin] PATH_INFO: `/v3/users/4a702add54724509bfb0e585a8aa4add` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:51.438223 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8781dc49-bede-4a25-a1bd-87af71f8d76d None admin] RBAC: Authorizing `identity:get_user(user_id=4a702add54724509bfb0e585a8aa4add)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:03:51.439742 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8781dc49-bede-4a25-a1bd-87af71f8d76d None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:03:51.441528 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 68/134] 10.222.0.136 () {56 vars in 1182 bytes} [Thu Jul 14 17:03:51 2022] GET /identity/v3/users/4a702add54724509bfb0e585a8aa4add => generated 276 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 17:03:51.448290 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8781dc49-bede-4a25-a1bd-87af71f8d76d None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:03:51.508780 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5bfb64-7516-43f2-82d4-a38c91a65446 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:03:51.579201 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e66a4d0-26e6-4cb9-968c-d410c6bee2ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:03:51.580163 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e66a4d0-26e6-4cb9-968c-d410c6bee2ae None admin] REQUEST_METHOD: `PUT` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:51.580491 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e66a4d0-26e6-4cb9-968c-d410c6bee2ae None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:51.580785 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e66a4d0-26e6-4cb9-968c-d410c6bee2ae None admin] PATH_INFO: `/v3/projects/8bd70064655e4aa5832910aaa0dd0116/users/4a702add54724509bfb0e585a8aa4add/roles/7441b1b1ab104537addd90a2471822f3` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:51.587244 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:03:51.587409 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e66a4d0-26e6-4cb9-968c-d410c6bee2ae None admin] RBAC: Authorizing `identity:create_grant(project_id=8bd70064655e4aa5832910aaa0dd0116, user_id=4a702add54724509bfb0e585a8aa4add, role_id=7441b1b1ab104537addd90a2471822f3)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:03:51.587488 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e66a4d0-26e6-4cb9-968c-d410c6bee2ae None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:03:51.613867 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 67/135] 10.222.0.136 () {58 vars in 1444 bytes} [Thu Jul 14 17:03:51 2022] PUT /identity/v3/projects/8bd70064655e4aa5832910aaa0dd0116/users/4a702add54724509bfb0e585a8aa4add/roles/7441b1b1ab104537addd90a2471822f3 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:03:51.632852 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8781dc49-bede-4a25-a1bd-87af71f8d76d None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:03:51.680103 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe57784f-18bd-49a5-a16c-43fd8a43b979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:03:51.681051 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe57784f-18bd-49a5-a16c-43fd8a43b979 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:51.681345 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe57784f-18bd-49a5-a16c-43fd8a43b979 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:51.681649 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe57784f-18bd-49a5-a16c-43fd8a43b979 None admin] PATH_INFO: `/v3/projects/9c1720fc409d4e229c899e34dd0306c7` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:51.683352 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe57784f-18bd-49a5-a16c-43fd8a43b979 None admin] RBAC: Authorizing `identity:get_project(project_id=9c1720fc409d4e229c899e34dd0306c7)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:03:51.684971 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe57784f-18bd-49a5-a16c-43fd8a43b979 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:03:51.686995 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 69/136] 10.222.0.136 () {56 vars in 1191 bytes} [Thu Jul 14 17:03:51 2022] GET /identity/v3/projects/9c1720fc409d4e229c899e34dd0306c7 => generated 313 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 17:03:51.693273 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e66a4d0-26e6-4cb9-968c-d410c6bee2ae None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:03:51.702476 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:03:51.831269 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e66a4d0-26e6-4cb9-968c-d410c6bee2ae None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:03:51.873115 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6de13c8-c287-44d4-9afb-dff10b3d99a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:03:51.874112 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6de13c8-c287-44d4-9afb-dff10b3d99a6 None admin] REQUEST_METHOD: `PUT` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:51.874439 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6de13c8-c287-44d4-9afb-dff10b3d99a6 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:51.874732 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6de13c8-c287-44d4-9afb-dff10b3d99a6 None admin] PATH_INFO: `/v3/projects/9c1720fc409d4e229c899e34dd0306c7/users/4a702add54724509bfb0e585a8aa4add/roles/7441b1b1ab104537addd90a2471822f3` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:51.876773 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6de13c8-c287-44d4-9afb-dff10b3d99a6 None admin] RBAC: Authorizing `identity:create_grant(project_id=9c1720fc409d4e229c899e34dd0306c7, user_id=4a702add54724509bfb0e585a8aa4add, role_id=7441b1b1ab104537addd90a2471822f3)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:03:51.878260 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6de13c8-c287-44d4-9afb-dff10b3d99a6 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:03:51.893389 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 68/137] 10.222.0.136 () {58 vars in 1444 bytes} [Thu Jul 14 17:03:51 2022] PUT /identity/v3/projects/9c1720fc409d4e229c899e34dd0306c7/users/4a702add54724509bfb0e585a8aa4add/roles/7441b1b1ab104537addd90a2471822f3 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:03:52.080468 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff05cdf-981f-40b5-abbf-5253b948c0da None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:52.080995 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff05cdf-981f-40b5-abbf-5253b948c0da None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:52.081071 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff05cdf-981f-40b5-abbf-5253b948c0da None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:52.082628 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 70/138] 10.222.0.136 () {54 vars in 931 bytes} [Thu Jul 14 17:03:52 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:03:52.089438 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b3ae71-0cc3-4df5-a88c-faaeaaafc033 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:52.089835 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b3ae71-0cc3-4df5-a88c-faaeaaafc033 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:52.090160 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b3ae71-0cc3-4df5-a88c-faaeaaafc033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:52.109120 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-52b3ae71-0cc3-4df5-a88c-faaeaaafc033 None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:03:52.110382 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-52b3ae71-0cc3-4df5-a88c-faaeaaafc033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:03:52.188959 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:03:52.197638 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 69/139] 10.222.0.136 () {58 vars in 1028 bytes} [Thu Jul 14 17:03:52 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 17:03:52.244864 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff05cdf-981f-40b5-abbf-5253b948c0da None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:03:52.383744 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff05cdf-981f-40b5-abbf-5253b948c0da None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:03:52.423219 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b84f8c5-2326-4087-9c44-9e6566bd1239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:03:52.424019 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b84f8c5-2326-4087-9c44-9e6566bd1239 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:52.424306 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b84f8c5-2326-4087-9c44-9e6566bd1239 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:52.424587 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b84f8c5-2326-4087-9c44-9e6566bd1239 None admin] PATH_INFO: `/v3/domains/default` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:52.426743 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b84f8c5-2326-4087-9c44-9e6566bd1239 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:03:52.428271 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b84f8c5-2326-4087-9c44-9e6566bd1239 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:03:52.430627 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 71/140] 10.222.0.136 () {56 vars in 1113 bytes} [Thu Jul 14 17:03:52 2022] GET /identity/v3/domains/default => generated 200 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:03:52.436177 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b3ae71-0cc3-4df5-a88c-faaeaaafc033 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:03:52.611717 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b3ae71-0cc3-4df5-a88c-faaeaaafc033 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:03:52.653729 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fdb4e8-9295-4716-806d-4947480525c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:03:52.654516 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fdb4e8-9295-4716-806d-4947480525c0 None admin] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:52.654843 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fdb4e8-9295-4716-806d-4947480525c0 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:52.655214 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fdb4e8-9295-4716-806d-4947480525c0 None admin] PATH_INFO: `/v3/users` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:52.655958 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fdb4e8-9295-4716-806d-4947480525c0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:03:52.657567 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fdb4e8-9295-4716-806d-4947480525c0 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:03:52.686082 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 70/141] 10.222.0.136 () {60 vars in 1137 bytes} [Thu Jul 14 17:03:52 2022] POST /identity/v3/users => generated 284 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 17:03:53.238399 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96527f4-7fd7-43f3-a0f9-4a01616efec0 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:53.238952 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96527f4-7fd7-43f3-a0f9-4a01616efec0 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:53.238952 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96527f4-7fd7-43f3-a0f9-4a01616efec0 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:53.240328 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 72/142] 10.222.0.136 () {54 vars in 931 bytes} [Thu Jul 14 17:03:53 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:03:53.246164 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a8c932-0ed4-44b2-9c5b-30a4c05307ef None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:53.246602 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a8c932-0ed4-44b2-9c5b-30a4c05307ef None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:53.246928 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a8c932-0ed4-44b2-9c5b-30a4c05307ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:53.265870 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-d5a8c932-0ed4-44b2-9c5b-30a4c05307ef None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:03:53.267201 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-d5a8c932-0ed4-44b2-9c5b-30a4c05307ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:03:53.317509 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:03:53.351558 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 71/143] 10.222.0.136 () {58 vars in 1028 bytes} [Thu Jul 14 17:03:53 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 17:03:53.392491 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96527f4-7fd7-43f3-a0f9-4a01616efec0 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:03:53.405182 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:03:53.527316 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96527f4-7fd7-43f3-a0f9-4a01616efec0 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:03:53.568443 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd98dc7-a84c-4d38-ae82-6a8edfe5a55e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:03:53.569926 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd98dc7-a84c-4d38-ae82-6a8edfe5a55e None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:53.570293 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd98dc7-a84c-4d38-ae82-6a8edfe5a55e None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:53.570589 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd98dc7-a84c-4d38-ae82-6a8edfe5a55e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:53.584542 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd98dc7-a84c-4d38-ae82-6a8edfe5a55e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 17:03:53.592973 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-bdd98dc7-a84c-4d38-ae82-6a8edfe5a55e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 17:03:53.592973 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:03:53.592973 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:03:53.592973 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:03:53.592973 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:03:53.592973 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:03:53.592973 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:03:53.592973 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:03:53.592973 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:03:53.592973 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:03:53.592973 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:03:53.592973 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:03:53.592973 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 17:03:53.592973 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 17:03:53.592973 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 17:03:53.592973 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 17:03:53.593953 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 17:03:53.593953 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 17:03:53.593953 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 17:03:53.593953 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 17:03:53.593953 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:03:53.593953 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:03:53.593953 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:03:53.593953 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:03:53.593953 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:03:53.593953 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:03:53.593953 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:03:53.593953 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Jul 14 17:03:53.593953 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:03:53.593953 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:03:53.593953 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:03:53.593953 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:03:53.594710 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:03:53.594710 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:03:53.594710 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:03:53.594710 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:03:53.594710 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 17:03:53.594710 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 17:03:53.594710 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 17:03:53.594710 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 17:03:53.594710 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 17:03:53.594710 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 17:03:53.594710 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 17:03:53.594710 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Jul 14 17:03:53.594710 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 73/144] 10.222.0.136 () {56 vars in 1101 bytes} [Thu Jul 14 17:03:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:03:53.601763 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a8c932-0ed4-44b2-9c5b-30a4c05307ef None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:03:53.718037 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2a6d2a-ef24-461a-a78e-92d34ab3423e None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:53.718339 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2a6d2a-ef24-461a-a78e-92d34ab3423e None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:53.718607 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2a6d2a-ef24-461a-a78e-92d34ab3423e None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:53.720125 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 74/145] 10.222.0.136 () {54 vars in 931 bytes} [Thu Jul 14 17:03:53 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 14 17:03:53.729262 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be0a26e-ae7c-4907-9461-40c4c4ce9f6c None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:53.729567 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be0a26e-ae7c-4907-9461-40c4c4ce9f6c None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:53.729990 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be0a26e-ae7c-4907-9461-40c4c4ce9f6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:53.736648 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a8c932-0ed4-44b2-9c5b-30a4c05307ef None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:03:53.763679 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-8be0a26e-ae7c-4907-9461-40c4c4ce9f6c None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:03:53.764900 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-8be0a26e-ae7c-4907-9461-40c4c4ce9f6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:03:53.783258 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c3ebc4-b5a8-4007-9b20-a1761b8d7055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:03:53.784438 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c3ebc4-b5a8-4007-9b20-a1761b8d7055 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:53.784739 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c3ebc4-b5a8-4007-9b20-a1761b8d7055 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:53.785448 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c3ebc4-b5a8-4007-9b20-a1761b8d7055 None admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:53.786303 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c3ebc4-b5a8-4007-9b20-a1761b8d7055 None admin] RBAC: Adding query filter params (name=admin) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:03:53.786780 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c3ebc4-b5a8-4007-9b20-a1761b8d7055 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:03:53.789143 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c3ebc4-b5a8-4007-9b20-a1761b8d7055 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:03:53.798999 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 72/146] 10.222.0.136 () {56 vars in 1104 bytes} [Thu Jul 14 17:03:53 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:03:53.805695 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c3ebc4-b5a8-4007-9b20-a1761b8d7055 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:03:53.874848 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:03:53.882001 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 75/147] 10.222.0.136 () {58 vars in 1028 bytes} [Thu Jul 14 17:03:53 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 17:03:53.882579 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:03:53.908182 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be0a26e-ae7c-4907-9461-40c4c4ce9f6c None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:03:54.019758 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c3ebc4-b5a8-4007-9b20-a1761b8d7055 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:03:54.040437 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be0a26e-ae7c-4907-9461-40c4c4ce9f6c None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:03:54.093464 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4111886c-be7f-4bc9-bb35-187ba3c1d6dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:03:54.094447 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4111886c-be7f-4bc9-bb35-187ba3c1d6dc None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:54.094735 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4111886c-be7f-4bc9-bb35-187ba3c1d6dc None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:54.095019 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4111886c-be7f-4bc9-bb35-187ba3c1d6dc None admin] PATH_INFO: `/v3/roles/reader` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:54.108755 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4111886c-be7f-4bc9-bb35-187ba3c1d6dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 17:03:54.118754 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-4111886c-be7f-4bc9-bb35-187ba3c1d6dc None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 17:03:54.118754 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:03:54.118754 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:03:54.118754 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:03:54.118754 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:03:54.118754 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:03:54.118754 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:03:54.118754 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:03:54.118754 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:03:54.118754 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:03:54.118754 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:03:54.118754 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:03:54.118754 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 17:03:54.118754 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 17:03:54.118754 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 17:03:54.118754 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 17:03:54.119653 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 17:03:54.119653 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 17:03:54.119653 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 17:03:54.119653 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 17:03:54.119653 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:03:54.119653 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:03:54.119653 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:03:54.119653 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:03:54.119653 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:03:54.119653 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:03:54.119653 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:03:54.119653 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Jul 14 17:03:54.119653 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:03:54.119653 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:03:54.119653 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:03:54.119653 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:03:54.120408 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:03:54.120408 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:03:54.120408 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:03:54.120408 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:03:54.120408 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 17:03:54.120408 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 17:03:54.120408 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 17:03:54.120408 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 17:03:54.120408 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 17:03:54.120408 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 17:03:54.120408 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 17:03:54.120408 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Jul 14 17:03:54.120981 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 76/148] 10.222.0.136 () {56 vars in 1104 bytes} [Thu Jul 14 17:03:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 17:03:54.128476 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4111886c-be7f-4bc9-bb35-187ba3c1d6dc None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:03:54.138293 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b854a52-f7e6-4bf9-8737-3ce8699c42b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:03:54.139198 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b854a52-f7e6-4bf9-8737-3ce8699c42b2 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:54.139487 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b854a52-f7e6-4bf9-8737-3ce8699c42b2 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:54.139768 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b854a52-f7e6-4bf9-8737-3ce8699c42b2 None admin] PATH_INFO: `/v3/users/2178b080bea24cb2a1f6b50c1554ccd2` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:54.146417 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b854a52-f7e6-4bf9-8737-3ce8699c42b2 None admin] RBAC: Authorizing `identity:get_user(user_id=2178b080bea24cb2a1f6b50c1554ccd2)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:03:54.149353 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b854a52-f7e6-4bf9-8737-3ce8699c42b2 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:03:54.152335 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 73/149] 10.222.0.136 () {56 vars in 1182 bytes} [Thu Jul 14 17:03:53 2022] GET /identity/v3/users/2178b080bea24cb2a1f6b50c1554ccd2 => generated 248 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:03:54.162742 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b854a52-f7e6-4bf9-8737-3ce8699c42b2 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:03:54.216603 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:03:54.282168 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4111886c-be7f-4bc9-bb35-187ba3c1d6dc None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:03:54.336765 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232e6bb4-e5bc-4009-a7bf-6d3bdae6d2fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:03:54.337538 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232e6bb4-e5bc-4009-a7bf-6d3bdae6d2fe None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:54.337855 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232e6bb4-e5bc-4009-a7bf-6d3bdae6d2fe None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:54.338143 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232e6bb4-e5bc-4009-a7bf-6d3bdae6d2fe None admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:54.338926 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232e6bb4-e5bc-4009-a7bf-6d3bdae6d2fe None admin] RBAC: Adding query filter params (name=reader) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:03:54.339244 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232e6bb4-e5bc-4009-a7bf-6d3bdae6d2fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:03:54.340649 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232e6bb4-e5bc-4009-a7bf-6d3bdae6d2fe None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:03:54.364331 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 77/150] 10.222.0.136 () {56 vars in 1106 bytes} [Thu Jul 14 17:03:54 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:03:54.366220 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232e6bb4-e5bc-4009-a7bf-6d3bdae6d2fe None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:03:54.371987 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b854a52-f7e6-4bf9-8737-3ce8699c42b2 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:03:54.389949 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:03:54.417903 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18da6ec-4841-4763-9967-46228c93cdea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:03:54.418184 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18da6ec-4841-4763-9967-46228c93cdea None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:54.418323 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18da6ec-4841-4763-9967-46228c93cdea None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:54.418771 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18da6ec-4841-4763-9967-46228c93cdea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:54.498569 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18da6ec-4841-4763-9967-46228c93cdea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:03:54.500432 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18da6ec-4841-4763-9967-46228c93cdea None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:03:54.552395 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232e6bb4-e5bc-4009-a7bf-6d3bdae6d2fe None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:03:54.592341 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:03:54.608386 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 74/151] 10.222.0.136 () {58 vars in 1287 bytes} [Thu Jul 14 17:03:54 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 17:03:54.614301 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384d7090-a879-40d9-b5b6-6d10d3cefaa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:03:54.614520 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18da6ec-4841-4763-9967-46228c93cdea None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:03:54.615603 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384d7090-a879-40d9-b5b6-6d10d3cefaa2 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:54.616697 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384d7090-a879-40d9-b5b6-6d10d3cefaa2 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:54.617383 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384d7090-a879-40d9-b5b6-6d10d3cefaa2 None admin] PATH_INFO: `/v3/users/c9fe1d1ff8a24ae28a4a1fc8085a85a1` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:54.618849 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384d7090-a879-40d9-b5b6-6d10d3cefaa2 None admin] RBAC: Authorizing `identity:get_user(user_id=c9fe1d1ff8a24ae28a4a1fc8085a85a1)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:03:54.620486 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384d7090-a879-40d9-b5b6-6d10d3cefaa2 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:03:54.627416 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 78/152] 10.222.0.136 () {56 vars in 1182 bytes} [Thu Jul 14 17:03:54 2022] GET /identity/v3/users/c9fe1d1ff8a24ae28a4a1fc8085a85a1 => generated 290 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 17:03:54.635812 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384d7090-a879-40d9-b5b6-6d10d3cefaa2 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:03:54.645950 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:03:54.764983 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18da6ec-4841-4763-9967-46228c93cdea None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:03:54.796128 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384d7090-a879-40d9-b5b6-6d10d3cefaa2 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:03:54.821467 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e815b092-aed5-4686-bd9b-e220403638a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:03:54.822494 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e815b092-aed5-4686-bd9b-e220403638a2 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:54.822784 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e815b092-aed5-4686-bd9b-e220403638a2 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:54.823074 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e815b092-aed5-4686-bd9b-e220403638a2 None admin] PATH_INFO: `/v3/projects/8bd70064655e4aa5832910aaa0dd0116` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:54.824374 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e815b092-aed5-4686-bd9b-e220403638a2 None admin] RBAC: Authorizing `identity:get_project(project_id=8bd70064655e4aa5832910aaa0dd0116)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:03:54.829573 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e815b092-aed5-4686-bd9b-e220403638a2 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:03:54.829573 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 75/153] 10.222.0.136 () {56 vars in 1191 bytes} [Thu Jul 14 17:03:54 2022] GET /identity/v3/projects/8bd70064655e4aa5832910aaa0dd0116 => generated 299 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 17:03:54.834120 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e815b092-aed5-4686-bd9b-e220403638a2 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:03:54.856231 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7998487-761f-4b7a-8789-ef0a1895cb34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:03:54.861872 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7998487-761f-4b7a-8789-ef0a1895cb34 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:54.862446 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7998487-761f-4b7a-8789-ef0a1895cb34 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:54.862932 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7998487-761f-4b7a-8789-ef0a1895cb34 None admin] PATH_INFO: `/v3/projects/8bd70064655e4aa5832910aaa0dd0116` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:54.864478 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7998487-761f-4b7a-8789-ef0a1895cb34 None admin] RBAC: Authorizing `identity:get_project(project_id=8bd70064655e4aa5832910aaa0dd0116)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:03:54.866918 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7998487-761f-4b7a-8789-ef0a1895cb34 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:03:54.873629 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 79/154] 10.222.0.136 () {56 vars in 1191 bytes} [Thu Jul 14 17:03:54 2022] GET /identity/v3/projects/8bd70064655e4aa5832910aaa0dd0116 => generated 299 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:03:54.878589 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7998487-761f-4b7a-8789-ef0a1895cb34 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:03:54.956114 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:03:54.989996 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:03:55.019914 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e815b092-aed5-4686-bd9b-e220403638a2 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:03:55.024060 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7998487-761f-4b7a-8789-ef0a1895cb34 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:03:55.058117 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf47c17-e74e-4105-b5be-072e45eeced8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:03:55.059206 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf47c17-e74e-4105-b5be-072e45eeced8 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:55.059499 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf47c17-e74e-4105-b5be-072e45eeced8 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:55.059784 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf47c17-e74e-4105-b5be-072e45eeced8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:55.060623 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf47c17-e74e-4105-b5be-072e45eeced8 None admin] RBAC: Adding query filter params (role.id=284c6314b4d3492085e397a87b0e3b51, scope.project.id=8bd70064655e4aa5832910aaa0dd0116, user.id=2178b080bea24cb2a1f6b50c1554ccd2) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:03:55.060936 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf47c17-e74e-4105-b5be-072e45eeced8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:03:55.062537 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf47c17-e74e-4105-b5be-072e45eeced8 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:03:55.070671 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 76/155] 10.222.0.136 () {56 vars in 1379 bytes} [Thu Jul 14 17:03:54 2022] GET /identity/v3/role_assignments?user.id=2178b080bea24cb2a1f6b50c1554ccd2&scope.project.id=8bd70064655e4aa5832910aaa0dd0116&role.id=284c6314b4d3492085e397a87b0e3b51 => generated 610 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 17:03:55.072727 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e80760-8765-4b0d-8f78-2912ccc4226b None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:55.073035 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e80760-8765-4b0d-8f78-2912ccc4226b None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:55.073573 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e80760-8765-4b0d-8f78-2912ccc4226b None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:55.075246 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 77/156] 10.222.0.136 () {54 vars in 931 bytes} [Thu Jul 14 17:03:55 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:03:55.081978 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ff1940-37f4-4cef-96ff-f604ca6eebf5 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:55.082302 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ff1940-37f4-4cef-96ff-f604ca6eebf5 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:55.082581 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ff1940-37f4-4cef-96ff-f604ca6eebf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:55.099646 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f5e594-98b8-440a-ac4c-d8de515d7377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:03:55.101459 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f5e594-98b8-440a-ac4c-d8de515d7377 None admin] REQUEST_METHOD: `PUT` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:55.102010 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f5e594-98b8-440a-ac4c-d8de515d7377 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:55.102192 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-f0ff1940-37f4-4cef-96ff-f604ca6eebf5 None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:03:55.102685 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f5e594-98b8-440a-ac4c-d8de515d7377 None admin] PATH_INFO: `/v3/projects/8bd70064655e4aa5832910aaa0dd0116/users/c9fe1d1ff8a24ae28a4a1fc8085a85a1/roles/2df0ddb31c5141c496d5705ff0dd2bc0` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:55.103440 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-f0ff1940-37f4-4cef-96ff-f604ca6eebf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:03:55.111313 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f5e594-98b8-440a-ac4c-d8de515d7377 None admin] RBAC: Authorizing `identity:create_grant(project_id=8bd70064655e4aa5832910aaa0dd0116, user_id=c9fe1d1ff8a24ae28a4a1fc8085a85a1, role_id=2df0ddb31c5141c496d5705ff0dd2bc0)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:03:55.113138 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f5e594-98b8-440a-ac4c-d8de515d7377 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:03:55.158907 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 80/157] 10.222.0.136 () {58 vars in 1444 bytes} [Thu Jul 14 17:03:54 2022] PUT /identity/v3/projects/8bd70064655e4aa5832910aaa0dd0116/users/c9fe1d1ff8a24ae28a4a1fc8085a85a1/roles/2df0ddb31c5141c496d5705ff0dd2bc0 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:03:55.223615 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 78/158] 10.222.0.136 () {58 vars in 1028 bytes} [Thu Jul 14 17:03:55 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 17:03:55.270134 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f5e594-98b8-440a-ac4c-d8de515d7377 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:03:55.421317 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f5e594-98b8-440a-ac4c-d8de515d7377 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:03:55.449246 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:03:55.471227 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9c41fc-8288-4f31-b179-de088104823b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:03:55.472058 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9c41fc-8288-4f31-b179-de088104823b None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:55.472348 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9c41fc-8288-4f31-b179-de088104823b None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:55.472629 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9c41fc-8288-4f31-b179-de088104823b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:55.487360 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9c41fc-8288-4f31-b179-de088104823b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 17:03:55.496214 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-2d9c41fc-8288-4f31-b179-de088104823b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 17:03:55.496214 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:03:55.496214 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:03:55.496214 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:03:55.496214 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:03:55.496214 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:03:55.496214 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:03:55.496214 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:03:55.496214 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:03:55.496214 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:03:55.496214 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:03:55.496214 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:03:55.496214 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 17:03:55.496214 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 17:03:55.496214 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 17:03:55.496214 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 17:03:55.497131 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 17:03:55.497131 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 17:03:55.497131 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 17:03:55.497131 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 17:03:55.497131 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:03:55.497131 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:03:55.497131 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:03:55.497131 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:03:55.497131 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:03:55.497131 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:03:55.497131 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:03:55.497131 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Jul 14 17:03:55.497131 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:03:55.497131 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:03:55.497131 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:03:55.497131 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:03:55.498456 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:03:55.498456 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:03:55.498456 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:03:55.498456 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:03:55.498456 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 17:03:55.498456 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 17:03:55.498456 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 17:03:55.498456 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 17:03:55.498456 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 17:03:55.498456 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 17:03:55.498456 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 17:03:55.498456 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Jul 14 17:03:55.498456 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 81/159] 10.222.0.136 () {56 vars in 1119 bytes} [Thu Jul 14 17:03:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:03:55.505436 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ff1940-37f4-4cef-96ff-f604ca6eebf5 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:03:55.595225 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eb56d9-4fe8-4119-98e8-095d3765e925 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:55.595553 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eb56d9-4fe8-4119-98e8-095d3765e925 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:55.595797 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eb56d9-4fe8-4119-98e8-095d3765e925 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:55.598426 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 82/160] 10.222.0.136 () {54 vars in 931 bytes} [Thu Jul 14 17:03:55 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 14 17:03:55.599619 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:03:55.625723 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d955a5-bd76-41d1-98bf-887ac6abc791 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:55.626032 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d955a5-bd76-41d1-98bf-887ac6abc791 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:55.626301 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d955a5-bd76-41d1-98bf-887ac6abc791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:55.634966 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ff1940-37f4-4cef-96ff-f604ca6eebf5 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:03:55.675061 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-a8d955a5-bd76-41d1-98bf-887ac6abc791 None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:03:55.676202 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-a8d955a5-bd76-41d1-98bf-887ac6abc791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:03:55.700219 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5087e357-a63d-4694-8761-34367a9bdc2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:03:55.701899 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5087e357-a63d-4694-8761-34367a9bdc2c None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:55.702403 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5087e357-a63d-4694-8761-34367a9bdc2c None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:55.703286 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5087e357-a63d-4694-8761-34367a9bdc2c None admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:55.704239 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5087e357-a63d-4694-8761-34367a9bdc2c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:03:55.704791 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5087e357-a63d-4694-8761-34367a9bdc2c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:03:55.706788 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5087e357-a63d-4694-8761-34367a9bdc2c None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:03:55.725231 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 79/161] 10.222.0.136 () {56 vars in 1116 bytes} [Thu Jul 14 17:03:55 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:03:55.728650 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5087e357-a63d-4694-8761-34367a9bdc2c None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:03:55.870075 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 83/162] 10.222.0.136 () {58 vars in 1028 bytes} [Thu Jul 14 17:03:55 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 17:03:55.871431 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e2c1af-cb85-4dcb-b445-f6656730242f None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:55.871723 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e2c1af-cb85-4dcb-b445-f6656730242f None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:55.872003 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e2c1af-cb85-4dcb-b445-f6656730242f None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:55.873279 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 84/163] 10.222.0.136 () {54 vars in 931 bytes} [Thu Jul 14 17:03:55 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:03:55.878773 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbe7c46-db92-4fde-a67c-749f463b6045 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:55.879063 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbe7c46-db92-4fde-a67c-749f463b6045 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:55.879348 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbe7c46-db92-4fde-a67c-749f463b6045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:55.893197 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5087e357-a63d-4694-8761-34367a9bdc2c None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:03:55.913179 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-1bbe7c46-db92-4fde-a67c-749f463b6045 None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:03:55.914413 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-1bbe7c46-db92-4fde-a67c-749f463b6045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:03:55.943190 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bf15b0-6a9e-4260-9625-bb50723bf3f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:03:55.944713 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bf15b0-6a9e-4260-9625-bb50723bf3f8 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:55.945006 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bf15b0-6a9e-4260-9625-bb50723bf3f8 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:55.945286 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bf15b0-6a9e-4260-9625-bb50723bf3f8 None admin] PATH_INFO: `/v3/users/4a702add54724509bfb0e585a8aa4add` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:55.950887 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bf15b0-6a9e-4260-9625-bb50723bf3f8 None admin] RBAC: Authorizing `identity:get_user(user_id=4a702add54724509bfb0e585a8aa4add)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:03:55.952373 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bf15b0-6a9e-4260-9625-bb50723bf3f8 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:03:55.955801 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 80/164] 10.222.0.136 () {56 vars in 1182 bytes} [Thu Jul 14 17:03:55 2022] GET /identity/v3/users/4a702add54724509bfb0e585a8aa4add => generated 276 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:03:55.956398 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bf15b0-6a9e-4260-9625-bb50723bf3f8 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:03:55.965945 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:03:56.041906 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 85/165] 10.222.0.136 () {58 vars in 1028 bytes} [Thu Jul 14 17:03:55 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 17:03:56.043052 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbe7c46-db92-4fde-a67c-749f463b6045 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:03:56.088693 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:03:56.172271 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbe7c46-db92-4fde-a67c-749f463b6045 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:03:56.201835 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bf15b0-6a9e-4260-9625-bb50723bf3f8 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:03:56.251908 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a56fb34-a0e6-41b5-867f-2f95fc5aa5ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:03:56.252571 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a56fb34-a0e6-41b5-867f-2f95fc5aa5ce None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:56.252856 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a56fb34-a0e6-41b5-867f-2f95fc5aa5ce None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:56.253134 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a56fb34-a0e6-41b5-867f-2f95fc5aa5ce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:56.304093 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd694f2c-8d55-460d-89fc-046b88d39d56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:03:56.305418 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd694f2c-8d55-460d-89fc-046b88d39d56 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:56.305915 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd694f2c-8d55-460d-89fc-046b88d39d56 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:56.306392 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd694f2c-8d55-460d-89fc-046b88d39d56 None admin] PATH_INFO: `/v3/roles/member` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:56.343758 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd694f2c-8d55-460d-89fc-046b88d39d56 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 17:03:56.363858 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-dd694f2c-8d55-460d-89fc-046b88d39d56 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 17:03:56.363858 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:03:56.363858 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:03:56.363858 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:03:56.363858 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:03:56.363858 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:03:56.363858 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:03:56.363858 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:03:56.363858 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:03:56.363858 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:03:56.363858 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:03:56.363858 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:03:56.363858 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 17:03:56.363858 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 17:03:56.363858 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 17:03:56.363858 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 17:03:56.364770 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 17:03:56.364770 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 17:03:56.364770 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 17:03:56.364770 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 17:03:56.364770 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:03:56.364770 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:03:56.364770 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:03:56.364770 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:03:56.364770 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:03:56.364770 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:03:56.364770 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:03:56.364770 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Jul 14 17:03:56.364770 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:03:56.364770 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:03:56.364770 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:03:56.364770 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:03:56.366377 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:03:56.366377 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:03:56.366377 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:03:56.366377 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:03:56.366377 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 17:03:56.366377 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 17:03:56.366377 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 17:03:56.366377 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 17:03:56.366377 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 17:03:56.366377 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 17:03:56.366377 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 17:03:56.366377 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Jul 14 17:03:56.371541 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 81/166] 10.222.0.136 () {56 vars in 1104 bytes} [Thu Jul 14 17:03:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 411 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:03:56.372374 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd694f2c-8d55-460d-89fc-046b88d39d56 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:03:56.427652 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a56fb34-a0e6-41b5-867f-2f95fc5aa5ce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:03:56.429296 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a56fb34-a0e6-41b5-867f-2f95fc5aa5ce None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:03:56.521332 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:03:56.544864 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:03:56.618563 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd694f2c-8d55-460d-89fc-046b88d39d56 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:03:56.681055 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ff45b2-b658-4d61-abe4-9165fbb0a485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:03:56.681957 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ff45b2-b658-4d61-abe4-9165fbb0a485 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:56.682245 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ff45b2-b658-4d61-abe4-9165fbb0a485 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:56.682527 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ff45b2-b658-4d61-abe4-9165fbb0a485 None admin] PATH_INFO: `/v3/roles/member` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:56.700434 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 86/167] 10.222.0.136 () {58 vars in 1287 bytes} [Thu Jul 14 17:03:56 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 658 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 17:03:56.701307 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a56fb34-a0e6-41b5-867f-2f95fc5aa5ce None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:03:56.707660 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ff45b2-b658-4d61-abe4-9165fbb0a485 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 17:03:56.722036 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-15ff45b2-b658-4d61-abe4-9165fbb0a485 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 17:03:56.722036 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:03:56.722036 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:03:56.722036 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:03:56.722036 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:03:56.722036 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:03:56.722036 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:03:56.722036 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:03:56.722036 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:03:56.722036 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:03:56.722036 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:03:56.722036 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:03:56.722036 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 17:03:56.722036 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 17:03:56.722036 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 17:03:56.722036 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 17:03:56.722982 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 17:03:56.722982 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 17:03:56.722982 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 17:03:56.722982 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 17:03:56.722982 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:03:56.722982 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:03:56.722982 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:03:56.722982 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:03:56.722982 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:03:56.722982 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:03:56.722982 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:03:56.722982 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Jul 14 17:03:56.722982 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:03:56.722982 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:03:56.722982 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:03:56.722982 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:03:56.723762 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:03:56.723762 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:03:56.723762 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:03:56.723762 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:03:56.723762 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 17:03:56.723762 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 17:03:56.723762 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 17:03:56.723762 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 17:03:56.723762 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 17:03:56.723762 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 17:03:56.723762 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 17:03:56.723762 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Jul 14 17:03:56.723762 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 82/168] 10.222.0.136 () {56 vars in 1104 bytes} [Thu Jul 14 17:03:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 351 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:03:56.724413 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ff45b2-b658-4d61-abe4-9165fbb0a485 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:03:56.873688 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a56fb34-a0e6-41b5-867f-2f95fc5aa5ce None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:03:56.929193 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5963f5ae-f481-4913-907e-e2a1cf3e6270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:03:56.930196 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5963f5ae-f481-4913-907e-e2a1cf3e6270 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:56.930532 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5963f5ae-f481-4913-907e-e2a1cf3e6270 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:56.930808 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5963f5ae-f481-4913-907e-e2a1cf3e6270 None admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:56.931817 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5963f5ae-f481-4913-907e-e2a1cf3e6270 None admin] RBAC: Adding query filter params (name=member) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:03:56.932126 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5963f5ae-f481-4913-907e-e2a1cf3e6270 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:03:56.933557 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5963f5ae-f481-4913-907e-e2a1cf3e6270 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:03:56.941885 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:03:56.950588 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 87/169] 10.222.0.136 () {56 vars in 1106 bytes} [Thu Jul 14 17:03:56 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:03:56.951499 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5963f5ae-f481-4913-907e-e2a1cf3e6270 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:03:56.988492 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ff45b2-b658-4d61-abe4-9165fbb0a485 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:03:57.026823 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:03:57.049760 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a13d11-cdde-449c-a047-8173f5c9f996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:03:57.050633 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a13d11-cdde-449c-a047-8173f5c9f996 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:57.050917 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a13d11-cdde-449c-a047-8173f5c9f996 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:57.051193 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a13d11-cdde-449c-a047-8173f5c9f996 None admin] PATH_INFO: `/v3/projects/8bd70064655e4aa5832910aaa0dd0116` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:57.055755 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a13d11-cdde-449c-a047-8173f5c9f996 None admin] RBAC: Authorizing `identity:get_project(project_id=8bd70064655e4aa5832910aaa0dd0116)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:03:57.057535 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a13d11-cdde-449c-a047-8173f5c9f996 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:03:57.059408 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 83/170] 10.222.0.136 () {56 vars in 1191 bytes} [Thu Jul 14 17:03:56 2022] GET /identity/v3/projects/8bd70064655e4aa5832910aaa0dd0116 => generated 299 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:03:57.060254 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a13d11-cdde-449c-a047-8173f5c9f996 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:03:57.233702 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a13d11-cdde-449c-a047-8173f5c9f996 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:03:57.272816 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5963f5ae-f481-4913-907e-e2a1cf3e6270 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:03:57.301787 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e936fa69-904e-404b-88b9-50196bbe71c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:03:57.301787 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e936fa69-904e-404b-88b9-50196bbe71c3 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:57.301787 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e936fa69-904e-404b-88b9-50196bbe71c3 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:57.301787 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e936fa69-904e-404b-88b9-50196bbe71c3 None admin] PATH_INFO: `/v3/users/4a702add54724509bfb0e585a8aa4add` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:57.302201 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e936fa69-904e-404b-88b9-50196bbe71c3 None admin] RBAC: Authorizing `identity:get_user(user_id=4a702add54724509bfb0e585a8aa4add)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:03:57.304398 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e936fa69-904e-404b-88b9-50196bbe71c3 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:03:57.317577 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 84/171] 10.222.0.136 () {56 vars in 1182 bytes} [Thu Jul 14 17:03:57 2022] GET /identity/v3/users/4a702add54724509bfb0e585a8aa4add => generated 276 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:03:57.317577 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e936fa69-904e-404b-88b9-50196bbe71c3 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:03:57.333475 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1130009a-930b-49cb-8ef1-572aee377e1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:03:57.334585 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1130009a-930b-49cb-8ef1-572aee377e1d None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:57.335093 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1130009a-930b-49cb-8ef1-572aee377e1d None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:57.335578 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1130009a-930b-49cb-8ef1-572aee377e1d None admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:57.336533 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1130009a-930b-49cb-8ef1-572aee377e1d None admin] RBAC: Adding query filter params (name=member) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:03:57.337038 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1130009a-930b-49cb-8ef1-572aee377e1d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:03:57.338637 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1130009a-930b-49cb-8ef1-572aee377e1d None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:03:57.358304 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 88/172] 10.222.0.136 () {56 vars in 1106 bytes} [Thu Jul 14 17:03:56 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 407 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:03:57.359377 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1130009a-930b-49cb-8ef1-572aee377e1d None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:03:57.457757 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:03:57.482246 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:03:57.542504 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1130009a-930b-49cb-8ef1-572aee377e1d None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:03:57.582032 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e936fa69-904e-404b-88b9-50196bbe71c3 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:03:57.594038 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6c58cc-f01f-4b91-8533-607c4bf67097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:03:57.594700 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6c58cc-f01f-4b91-8533-607c4bf67097 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:57.595029 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6c58cc-f01f-4b91-8533-607c4bf67097 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:57.595309 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6c58cc-f01f-4b91-8533-607c4bf67097 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:57.658813 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c586bb42-3961-4a97-959a-4e93d492cbbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:03:57.659528 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c586bb42-3961-4a97-959a-4e93d492cbbb None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:57.659815 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c586bb42-3961-4a97-959a-4e93d492cbbb None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:57.660095 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c586bb42-3961-4a97-959a-4e93d492cbbb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:57.664505 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c586bb42-3961-4a97-959a-4e93d492cbbb None admin] RBAC: Adding query filter params (role.id=5e321db416444dc9b5bfce7db763a7ed, scope.project.id=8bd70064655e4aa5832910aaa0dd0116, user.id=4a702add54724509bfb0e585a8aa4add) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:03:57.664833 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c586bb42-3961-4a97-959a-4e93d492cbbb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:03:57.666322 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c586bb42-3961-4a97-959a-4e93d492cbbb None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:03:57.682587 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 85/173] 10.222.0.136 () {56 vars in 1379 bytes} [Thu Jul 14 17:03:57 2022] GET /identity/v3/role_assignments?user.id=4a702add54724509bfb0e585a8aa4add&scope.project.id=8bd70064655e4aa5832910aaa0dd0116&role.id=5e321db416444dc9b5bfce7db763a7ed => generated 610 bytes in 368 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:03:57.695119 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c586bb42-3961-4a97-959a-4e93d492cbbb None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:03:57.767034 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6c58cc-f01f-4b91-8533-607c4bf67097 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:03:57.768666 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6c58cc-f01f-4b91-8533-607c4bf67097 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:03:57.887891 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:03:57.942243 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 89/174] 10.222.0.136 () {58 vars in 1287 bytes} [Thu Jul 14 17:03:57 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 579 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 17:03:57.944199 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0eac18-3e08-4c53-b79c-3998f8e5befa None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:57.944493 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0eac18-3e08-4c53-b79c-3998f8e5befa None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:57.944793 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0eac18-3e08-4c53-b79c-3998f8e5befa None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:57.947494 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 90/175] 10.222.0.136 () {54 vars in 931 bytes} [Thu Jul 14 17:03:57 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:03:57.950204 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0eac18-3e08-4c53-b79c-3998f8e5befa None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:03:57.952112 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c586bb42-3961-4a97-959a-4e93d492cbbb None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:03:57.990170 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:03:58.017215 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e6c260-61d9-44ad-bfbd-3ebf587a8b45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:03:58.018057 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e6c260-61d9-44ad-bfbd-3ebf587a8b45 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:58.018349 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e6c260-61d9-44ad-bfbd-3ebf587a8b45 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:58.018636 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e6c260-61d9-44ad-bfbd-3ebf587a8b45 None admin] PATH_INFO: `/v3/users/4a702add54724509bfb0e585a8aa4add` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:58.023567 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e6c260-61d9-44ad-bfbd-3ebf587a8b45 None admin] RBAC: Authorizing `identity:get_user(user_id=4a702add54724509bfb0e585a8aa4add)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:03:58.025052 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e6c260-61d9-44ad-bfbd-3ebf587a8b45 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:03:58.026780 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 86/176] 10.222.0.136 () {56 vars in 1182 bytes} [Thu Jul 14 17:03:57 2022] GET /identity/v3/users/4a702add54724509bfb0e585a8aa4add => generated 276 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:03:58.027985 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f830f63a-601c-4c5c-a418-130c569c2db7 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:58.028281 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f830f63a-601c-4c5c-a418-130c569c2db7 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:58.028571 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f830f63a-601c-4c5c-a418-130c569c2db7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:58.050449 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-f830f63a-601c-4c5c-a418-130c569c2db7 None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:03:58.051676 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-f830f63a-601c-4c5c-a418-130c569c2db7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:03:58.149129 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 87/177] 10.222.0.136 () {58 vars in 1028 bytes} [Thu Jul 14 17:03:58 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 17:03:58.150045 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f830f63a-601c-4c5c-a418-130c569c2db7 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:03:58.215039 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0eac18-3e08-4c53-b79c-3998f8e5befa None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:03:58.264795 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fdc132-3010-4425-b01d-bd79befe7297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:03:58.265827 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fdc132-3010-4425-b01d-bd79befe7297 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:58.266182 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fdc132-3010-4425-b01d-bd79befe7297 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:58.266528 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fdc132-3010-4425-b01d-bd79befe7297 None admin] PATH_INFO: `/v3/projects/9c1720fc409d4e229c899e34dd0306c7` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:58.267851 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fdc132-3010-4425-b01d-bd79befe7297 None admin] RBAC: Authorizing `identity:get_project(project_id=9c1720fc409d4e229c899e34dd0306c7)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:03:58.269383 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fdc132-3010-4425-b01d-bd79befe7297 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:03:58.271401 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 91/178] 10.222.0.136 () {56 vars in 1191 bytes} [Thu Jul 14 17:03:57 2022] GET /identity/v3/projects/9c1720fc409d4e229c899e34dd0306c7 => generated 313 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:03:58.273222 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e209b55-c3d5-4e74-b810-dd009ff0a556 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:58.273571 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e209b55-c3d5-4e74-b810-dd009ff0a556 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:58.273867 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e209b55-c3d5-4e74-b810-dd009ff0a556 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:58.275380 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 92/179] 10.222.0.136 () {54 vars in 931 bytes} [Thu Jul 14 17:03:58 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:03:58.276092 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e209b55-c3d5-4e74-b810-dd009ff0a556 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:03:58.298533 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f830f63a-601c-4c5c-a418-130c569c2db7 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:03:58.306211 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:03:58.325919 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:03:58.343954 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b191bf-4028-48b6-b0e7-f39529475eda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:03:58.344765 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b191bf-4028-48b6-b0e7-f39529475eda None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:58.345199 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b191bf-4028-48b6-b0e7-f39529475eda None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:58.345485 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b191bf-4028-48b6-b0e7-f39529475eda None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:58.400183 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e209b55-c3d5-4e74-b810-dd009ff0a556 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:03:58.427094 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b191bf-4028-48b6-b0e7-f39529475eda None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:03:58.428597 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b191bf-4028-48b6-b0e7-f39529475eda None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:03:58.438036 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6fe888-59c7-4184-8602-53648d42770a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:03:58.439128 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6fe888-59c7-4184-8602-53648d42770a None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:58.439548 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6fe888-59c7-4184-8602-53648d42770a None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:58.440075 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6fe888-59c7-4184-8602-53648d42770a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:58.451869 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6fe888-59c7-4184-8602-53648d42770a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 17:03:58.461235 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-1c6fe888-59c7-4184-8602-53648d42770a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 17:03:58.461235 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:03:58.461235 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:03:58.461235 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:03:58.461235 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:03:58.461235 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:03:58.461235 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:03:58.461235 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:03:58.461235 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:03:58.461235 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:03:58.461235 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:03:58.461235 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:03:58.461235 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 17:03:58.461235 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 17:03:58.461235 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 17:03:58.461235 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 17:03:58.462559 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 17:03:58.462559 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 17:03:58.462559 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 17:03:58.462559 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 17:03:58.462559 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:03:58.462559 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:03:58.462559 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:03:58.462559 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:03:58.462559 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:03:58.462559 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:03:58.462559 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:03:58.462559 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Jul 14 17:03:58.462559 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:03:58.462559 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:03:58.462559 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:03:58.462559 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:03:58.463553 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:03:58.463553 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:03:58.463553 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:03:58.463553 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:03:58.463553 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 17:03:58.463553 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 17:03:58.463553 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 17:03:58.463553 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 17:03:58.463553 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 17:03:58.463553 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 17:03:58.463553 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 17:03:58.463553 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Jul 14 17:03:58.463553 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 93/180] 10.222.0.136 () {56 vars in 1101 bytes} [Thu Jul 14 17:03:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:03:58.463553 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60bfb2d-3f66-46d2-8c7f-5c55720b6403 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:58.464419 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60bfb2d-3f66-46d2-8c7f-5c55720b6403 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:58.464419 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60bfb2d-3f66-46d2-8c7f-5c55720b6403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:58.483236 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-c60bfb2d-3f66-46d2-8c7f-5c55720b6403 None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:03:58.484450 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-c60bfb2d-3f66-46d2-8c7f-5c55720b6403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:03:58.547565 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 88/181] 10.222.0.136 () {58 vars in 1287 bytes} [Thu Jul 14 17:03:58 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 17:03:58.548436 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b191bf-4028-48b6-b0e7-f39529475eda None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:03:58.563763 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 94/182] 10.222.0.136 () {58 vars in 1028 bytes} [Thu Jul 14 17:03:58 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 17:03:58.572837 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:03:58.575104 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce43a668-fa1a-4557-a6db-d0c9bdfbf8e1 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:58.575295 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce43a668-fa1a-4557-a6db-d0c9bdfbf8e1 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:58.575578 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce43a668-fa1a-4557-a6db-d0c9bdfbf8e1 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:58.577131 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 95/183] 10.222.0.136 () {54 vars in 931 bytes} [Thu Jul 14 17:03:58 2022] GET /identity => generated 271 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:03:58.577738 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce43a668-fa1a-4557-a6db-d0c9bdfbf8e1 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:03:58.599492 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:03:58.658186 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b191bf-4028-48b6-b0e7-f39529475eda None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:03:58.687680 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce43a668-fa1a-4557-a6db-d0c9bdfbf8e1 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:03:58.691970 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c047a891-b2dc-41a2-b67a-f83330573a8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:03:58.692625 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c047a891-b2dc-41a2-b67a-f83330573a8c None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:58.692908 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c047a891-b2dc-41a2-b67a-f83330573a8c None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:58.693182 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c047a891-b2dc-41a2-b67a-f83330573a8c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:58.694065 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c047a891-b2dc-41a2-b67a-f83330573a8c None admin] RBAC: Adding query filter params (role.id=7441b1b1ab104537addd90a2471822f3, scope.project.id=9c1720fc409d4e229c899e34dd0306c7, user.id=4a702add54724509bfb0e585a8aa4add) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:03:58.694373 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c047a891-b2dc-41a2-b67a-f83330573a8c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:03:58.695823 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c047a891-b2dc-41a2-b67a-f83330573a8c None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:03:58.701476 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 89/184] 10.222.0.136 () {56 vars in 1379 bytes} [Thu Jul 14 17:03:58 2022] GET /identity/v3/role_assignments?user.id=4a702add54724509bfb0e585a8aa4add&scope.project.id=9c1720fc409d4e229c899e34dd0306c7&role.id=7441b1b1ab104537addd90a2471822f3 => generated 610 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:03:58.702263 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c047a891-b2dc-41a2-b67a-f83330573a8c None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:03:58.723404 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b32d81-cc55-43d3-be8c-957fcdb5bed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:03:58.724461 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b32d81-cc55-43d3-be8c-957fcdb5bed0 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:58.725697 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b32d81-cc55-43d3-be8c-957fcdb5bed0 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:58.726166 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b32d81-cc55-43d3-be8c-957fcdb5bed0 None admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:58.727130 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b32d81-cc55-43d3-be8c-957fcdb5bed0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:03:58.727627 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b32d81-cc55-43d3-be8c-957fcdb5bed0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:03:58.729257 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b32d81-cc55-43d3-be8c-957fcdb5bed0 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:03:58.739278 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 96/185] 10.222.0.136 () {56 vars in 1104 bytes} [Thu Jul 14 17:03:58 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:03:58.744141 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47a2adb-fb96-4727-8f8a-9b7b6497ac47 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:58.744141 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47a2adb-fb96-4727-8f8a-9b7b6497ac47 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:58.744141 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47a2adb-fb96-4727-8f8a-9b7b6497ac47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:58.758708 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-f47a2adb-fb96-4727-8f8a-9b7b6497ac47 None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:03:58.768240 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-f47a2adb-fb96-4727-8f8a-9b7b6497ac47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:03:58.816206 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:03:58.837128 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c047a891-b2dc-41a2-b67a-f83330573a8c None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:03:58.844804 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 97/186] 10.222.0.136 () {58 vars in 1028 bytes} [Thu Jul 14 17:03:58 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 17:03:58.853798 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47a2adb-fb96-4727-8f8a-9b7b6497ac47 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:03:58.865337 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:03:58.893348 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71e45ba-ede2-4825-8314-0d3bd891bd07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:03:58.895371 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71e45ba-ede2-4825-8314-0d3bd891bd07 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:58.895814 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71e45ba-ede2-4825-8314-0d3bd891bd07 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:58.896240 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71e45ba-ede2-4825-8314-0d3bd891bd07 None admin] PATH_INFO: `/v3/projects/8bd70064655e4aa5832910aaa0dd0116` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:58.898344 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71e45ba-ede2-4825-8314-0d3bd891bd07 None admin] RBAC: Authorizing `identity:get_project(project_id=8bd70064655e4aa5832910aaa0dd0116)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:03:58.900893 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71e45ba-ede2-4825-8314-0d3bd891bd07 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:03:58.901594 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 90/187] 10.222.0.136 () {56 vars in 1191 bytes} [Thu Jul 14 17:03:58 2022] GET /identity/v3/projects/8bd70064655e4aa5832910aaa0dd0116 => generated 299 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:03:58.902824 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd88378-3826-4909-873d-2a4cfa9b5ad0 None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:58.903086 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd88378-3826-4909-873d-2a4cfa9b5ad0 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:58.903371 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd88378-3826-4909-873d-2a4cfa9b5ad0 None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:58.904600 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 91/188] 10.222.0.136 () {54 vars in 931 bytes} [Thu Jul 14 17:03:58 2022] GET /identity => generated 271 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:03:58.907509 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd88378-3826-4909-873d-2a4cfa9b5ad0 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:03:58.974688 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47a2adb-fb96-4727-8f8a-9b7b6497ac47 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:03:59.013901 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a101b552-41e5-4d96-af6f-bacabce0be0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:03:59.014793 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a101b552-41e5-4d96-af6f-bacabce0be0e None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:59.015086 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a101b552-41e5-4d96-af6f-bacabce0be0e None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:59.015365 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a101b552-41e5-4d96-af6f-bacabce0be0e None admin] PATH_INFO: `/v3/domains/default` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:59.016532 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a101b552-41e5-4d96-af6f-bacabce0be0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:03:59.018022 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a101b552-41e5-4d96-af6f-bacabce0be0e None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:03:59.019629 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 98/189] 10.222.0.136 () {56 vars in 1113 bytes} [Thu Jul 14 17:03:58 2022] GET /identity/v3/domains/default => generated 200 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:03:59.020444 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a101b552-41e5-4d96-af6f-bacabce0be0e None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:03:59.028882 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd88378-3826-4909-873d-2a4cfa9b5ad0 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:03:59.063340 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a5f3df-ef41-44f2-8d05-92b3422cfcac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:03:59.064212 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a5f3df-ef41-44f2-8d05-92b3422cfcac None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:59.064498 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a5f3df-ef41-44f2-8d05-92b3422cfcac None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:59.064780 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a5f3df-ef41-44f2-8d05-92b3422cfcac None admin] PATH_INFO: `/v3/users/962034238a674c5b87a85e8680ea60de` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:59.079180 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a5f3df-ef41-44f2-8d05-92b3422cfcac None admin] RBAC: Authorizing `identity:get_user(user_id=962034238a674c5b87a85e8680ea60de)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:03:59.080579 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a5f3df-ef41-44f2-8d05-92b3422cfcac None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:03:59.082478 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 92/190] 10.222.0.136 () {56 vars in 1182 bytes} [Thu Jul 14 17:03:58 2022] GET /identity/v3/users/962034238a674c5b87a85e8680ea60de => generated 284 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:03:59.083059 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a5f3df-ef41-44f2-8d05-92b3422cfcac None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:03:59.095346 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:03:59.105581 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:03:59.128445 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a101b552-41e5-4d96-af6f-bacabce0be0e None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:03:59.162870 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc820c81-6928-4341-8293-42055ac47aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:03:59.163679 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc820c81-6928-4341-8293-42055ac47aee None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:59.163963 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc820c81-6928-4341-8293-42055ac47aee None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:59.164264 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc820c81-6928-4341-8293-42055ac47aee None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:59.174280 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc820c81-6928-4341-8293-42055ac47aee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 17:03:59.182324 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-cc820c81-6928-4341-8293-42055ac47aee None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 17:03:59.182324 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:03:59.182324 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:03:59.182324 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:03:59.182324 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:03:59.182324 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:03:59.182324 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:03:59.182324 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:03:59.182324 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:03:59.182324 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:03:59.182324 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:03:59.182324 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:03:59.182324 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 17:03:59.182324 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 17:03:59.182324 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 17:03:59.182324 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 17:03:59.183492 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 17:03:59.183492 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 17:03:59.183492 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 17:03:59.183492 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 17:03:59.183492 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:03:59.183492 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:03:59.183492 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:03:59.183492 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:03:59.183492 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:03:59.183492 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:03:59.183492 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:03:59.183492 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Jul 14 17:03:59.183492 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:03:59.183492 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:03:59.183492 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:03:59.183492 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:03:59.184289 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:03:59.184289 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:03:59.184289 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:03:59.184289 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:03:59.184289 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 17:03:59.184289 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 17:03:59.184289 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 17:03:59.184289 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 17:03:59.184289 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 17:03:59.184289 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 17:03:59.184289 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 17:03:59.184289 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Jul 14 17:03:59.185122 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a5f3df-ef41-44f2-8d05-92b3422cfcac None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:03:59.185194 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 99/191] 10.222.0.136 () {56 vars in 1119 bytes} [Thu Jul 14 17:03:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:03:59.185194 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff9c85a-169b-4695-90bc-3b962f7ff4f2 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:59.185194 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff9c85a-169b-4695-90bc-3b962f7ff4f2 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:59.185194 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff9c85a-169b-4695-90bc-3b962f7ff4f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:59.202457 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-7ff9c85a-169b-4695-90bc-3b962f7ff4f2 None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:03:59.203672 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-7ff9c85a-169b-4695-90bc-3b962f7ff4f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:03:59.221623 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b81ecec-6f68-42db-b880-3b1985a1e3ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:03:59.222286 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b81ecec-6f68-42db-b880-3b1985a1e3ba None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:59.222567 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b81ecec-6f68-42db-b880-3b1985a1e3ba None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:59.222842 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b81ecec-6f68-42db-b880-3b1985a1e3ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:59.223666 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b81ecec-6f68-42db-b880-3b1985a1e3ba None admin] RBAC: Adding query filter params (role.id=7441b1b1ab104537addd90a2471822f3, scope.project.id=8bd70064655e4aa5832910aaa0dd0116, user.id=4a702add54724509bfb0e585a8aa4add) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:03:59.223977 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b81ecec-6f68-42db-b880-3b1985a1e3ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:03:59.226212 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b81ecec-6f68-42db-b880-3b1985a1e3ba None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:03:59.232195 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 93/192] 10.222.0.136 () {56 vars in 1379 bytes} [Thu Jul 14 17:03:59 2022] GET /identity/v3/role_assignments?user.id=4a702add54724509bfb0e585a8aa4add&scope.project.id=8bd70064655e4aa5832910aaa0dd0116&role.id=7441b1b1ab104537addd90a2471822f3 => generated 610 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:03:59.232950 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b81ecec-6f68-42db-b880-3b1985a1e3ba None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:03:59.284074 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 100/193] 10.222.0.136 () {58 vars in 1028 bytes} [Thu Jul 14 17:03:59 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 17:03:59.293810 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff9c85a-169b-4695-90bc-3b962f7ff4f2 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:03:59.341230 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:03:59.363513 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:03:59.370940 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b81ecec-6f68-42db-b880-3b1985a1e3ba None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:03:59.404924 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff9c85a-169b-4695-90bc-3b962f7ff4f2 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:03:59.409224 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4546f12f-775e-4f5a-872e-841dfecb1cac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:03:59.409972 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4546f12f-775e-4f5a-872e-841dfecb1cac None admin] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:59.410263 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4546f12f-775e-4f5a-872e-841dfecb1cac None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:59.410548 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4546f12f-775e-4f5a-872e-841dfecb1cac None admin] PATH_INFO: `/v3/users` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:59.411492 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4546f12f-775e-4f5a-872e-841dfecb1cac None admin] RBAC: Authorizing `identity:create_user()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:03:59.413151 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4546f12f-775e-4f5a-872e-841dfecb1cac None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:03:59.434783 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 94/194] 10.222.0.136 () {60 vars in 1137 bytes} [Thu Jul 14 17:03:59 2022] POST /identity/v3/users => generated 298 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 17:03:59.436074 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4546f12f-775e-4f5a-872e-841dfecb1cac None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:03:59.455419 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875d555a-198f-46b8-8866-9f79dbe90073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:03:59.456368 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875d555a-198f-46b8-8866-9f79dbe90073 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:59.456700 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875d555a-198f-46b8-8866-9f79dbe90073 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:59.457076 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875d555a-198f-46b8-8866-9f79dbe90073 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:59.542083 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875d555a-198f-46b8-8866-9f79dbe90073 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:03:59.544050 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875d555a-198f-46b8-8866-9f79dbe90073 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:03:59.563139 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4546f12f-775e-4f5a-872e-841dfecb1cac None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:03:59.601609 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:03:59.608852 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935a7da6-2b06-47f2-b4da-d8037b8228a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:03:59.609483 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935a7da6-2b06-47f2-b4da-d8037b8228a2 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:59.609801 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935a7da6-2b06-47f2-b4da-d8037b8228a2 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:59.610080 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935a7da6-2b06-47f2-b4da-d8037b8228a2 None admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:59.610866 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935a7da6-2b06-47f2-b4da-d8037b8228a2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:03:59.611321 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935a7da6-2b06-47f2-b4da-d8037b8228a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:03:59.613286 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935a7da6-2b06-47f2-b4da-d8037b8228a2 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:03:59.622250 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 95/195] 10.222.0.136 () {56 vars in 1116 bytes} [Thu Jul 14 17:03:59 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:03:59.623029 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:03:59.623149 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935a7da6-2b06-47f2-b4da-d8037b8228a2 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:03:59.672338 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 101/196] 10.222.0.136 () {58 vars in 1287 bytes} [Thu Jul 14 17:03:59 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 17:03:59.673496 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875d555a-198f-46b8-8866-9f79dbe90073 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:03:59.760286 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935a7da6-2b06-47f2-b4da-d8037b8228a2 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:03:59.798472 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875d555a-198f-46b8-8866-9f79dbe90073 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:03:59.816001 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8a3c18-8373-432c-8d1c-4aaef230ef68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:03:59.817641 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8a3c18-8373-432c-8d1c-4aaef230ef68 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:59.818211 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8a3c18-8373-432c-8d1c-4aaef230ef68 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:59.819572 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8a3c18-8373-432c-8d1c-4aaef230ef68 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:59.835360 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8a3c18-8373-432c-8d1c-4aaef230ef68 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 17:03:59.839744 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5577f18c-8188-4c74-9511-3dcc1ac04f93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:03:59.840621 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5577f18c-8188-4c74-9511-3dcc1ac04f93 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:03:59.840905 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5577f18c-8188-4c74-9511-3dcc1ac04f93 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:03:59.841186 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5577f18c-8188-4c74-9511-3dcc1ac04f93 None admin] PATH_INFO: `/v3/users/962034238a674c5b87a85e8680ea60de` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:03:59.842425 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5577f18c-8188-4c74-9511-3dcc1ac04f93 None admin] RBAC: Authorizing `identity:get_user(user_id=962034238a674c5b87a85e8680ea60de)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:03:59.843863 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5577f18c-8188-4c74-9511-3dcc1ac04f93 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:03:59.845664 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 102/197] 10.222.0.136 () {56 vars in 1182 bytes} [Thu Jul 14 17:03:59 2022] GET /identity/v3/users/962034238a674c5b87a85e8680ea60de => generated 284 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:03:59.846257 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5577f18c-8188-4c74-9511-3dcc1ac04f93 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:03:59.847002 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-cf8a3c18-8373-432c-8d1c-4aaef230ef68 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 17:03:59.847002 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:03:59.847002 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:03:59.847002 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:03:59.847002 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:03:59.847002 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:03:59.847002 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:03:59.847002 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:03:59.847002 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:03:59.847002 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:03:59.847002 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:03:59.847002 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:03:59.847002 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 17:03:59.847002 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 17:03:59.847002 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 17:03:59.847002 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 17:03:59.847834 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 17:03:59.847834 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 17:03:59.847834 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 17:03:59.847834 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 17:03:59.847834 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:03:59.847834 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:03:59.847834 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:03:59.847834 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:03:59.847834 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:03:59.847834 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:03:59.847834 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:03:59.847834 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Jul 14 17:03:59.847834 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:03:59.847834 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:03:59.847834 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:03:59.847834 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:03:59.848665 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:03:59.848665 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:03:59.848665 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:03:59.848665 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:03:59.848665 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 17:03:59.848665 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 17:03:59.848665 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 17:03:59.848665 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 17:03:59.848665 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 17:03:59.848665 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 17:03:59.848665 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 17:03:59.848665 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Jul 14 17:03:59.854471 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 96/198] 10.222.0.136 () {56 vars in 1104 bytes} [Thu Jul 14 17:03:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:03:59.854671 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8a3c18-8373-432c-8d1c-4aaef230ef68 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:03:59.894815 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:03:59.931653 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:03:59.986056 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8a3c18-8373-432c-8d1c-4aaef230ef68 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:03:59.991572 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5577f18c-8188-4c74-9511-3dcc1ac04f93 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:00.033806 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df174fb-267a-4807-bd66-2e18efebdf24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:00.034465 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df174fb-267a-4807-bd66-2e18efebdf24 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:00.034750 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df174fb-267a-4807-bd66-2e18efebdf24 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:00.035029 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df174fb-267a-4807-bd66-2e18efebdf24 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:00.043819 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3c0643-0524-4349-970f-d7e1e040c7fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:00.045509 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3c0643-0524-4349-970f-d7e1e040c7fe None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:00.046019 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3c0643-0524-4349-970f-d7e1e040c7fe None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:00.046516 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3c0643-0524-4349-970f-d7e1e040c7fe None admin] PATH_INFO: `/v3/projects/dc58de68345f40498e25fd3ab4626f7f` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:00.048798 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3c0643-0524-4349-970f-d7e1e040c7fe None admin] RBAC: Authorizing `identity:get_project(project_id=dc58de68345f40498e25fd3ab4626f7f)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:00.050994 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3c0643-0524-4349-970f-d7e1e040c7fe None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:00.059123 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 103/199] 10.222.0.136 () {56 vars in 1191 bytes} [Thu Jul 14 17:03:59 2022] GET /identity/v3/projects/dc58de68345f40498e25fd3ab4626f7f => generated 303 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:04:00.059123 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3c0643-0524-4349-970f-d7e1e040c7fe None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:00.135486 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df174fb-267a-4807-bd66-2e18efebdf24 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:00.138538 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df174fb-267a-4807-bd66-2e18efebdf24 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:00.170640 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3c0643-0524-4349-970f-d7e1e040c7fe None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:00.173838 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:00.212500 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:00.218315 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bc45a8-e0ce-41a1-a031-d04925c81cad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:00.219020 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bc45a8-e0ce-41a1-a031-d04925c81cad None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:00.219764 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bc45a8-e0ce-41a1-a031-d04925c81cad None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:00.219764 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bc45a8-e0ce-41a1-a031-d04925c81cad None admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:00.220294 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bc45a8-e0ce-41a1-a031-d04925c81cad None admin] RBAC: Adding query filter params (name=reader) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:04:00.220611 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bc45a8-e0ce-41a1-a031-d04925c81cad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:00.222021 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bc45a8-e0ce-41a1-a031-d04925c81cad None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:00.231195 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 104/200] 10.222.0.136 () {56 vars in 1106 bytes} [Thu Jul 14 17:04:00 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:04:00.232260 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bc45a8-e0ce-41a1-a031-d04925c81cad None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:00.278368 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 97/201] 10.222.0.136 () {58 vars in 1287 bytes} [Thu Jul 14 17:03:59 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 14 17:04:00.279323 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df174fb-267a-4807-bd66-2e18efebdf24 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:00.341920 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bc45a8-e0ce-41a1-a031-d04925c81cad None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:00.378387 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ca4333-02ed-431c-b0e6-a1a3c20e3cba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:00.379155 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ca4333-02ed-431c-b0e6-a1a3c20e3cba None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:00.379480 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ca4333-02ed-431c-b0e6-a1a3c20e3cba None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:00.379758 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ca4333-02ed-431c-b0e6-a1a3c20e3cba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:00.380591 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ca4333-02ed-431c-b0e6-a1a3c20e3cba None admin] RBAC: Adding query filter params (role.id=284c6314b4d3492085e397a87b0e3b51, scope.project.id=dc58de68345f40498e25fd3ab4626f7f, user.id=962034238a674c5b87a85e8680ea60de) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:04:00.380902 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ca4333-02ed-431c-b0e6-a1a3c20e3cba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:00.382792 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ca4333-02ed-431c-b0e6-a1a3c20e3cba None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:00.389088 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 105/202] 10.222.0.136 () {56 vars in 1379 bytes} [Thu Jul 14 17:04:00 2022] GET /identity/v3/role_assignments?user.id=962034238a674c5b87a85e8680ea60de&scope.project.id=dc58de68345f40498e25fd3ab4626f7f&role.id=284c6314b4d3492085e397a87b0e3b51 => generated 260 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:04:00.389856 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ca4333-02ed-431c-b0e6-a1a3c20e3cba None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:00.391707 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df174fb-267a-4807-bd66-2e18efebdf24 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:00.428411 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:00.450678 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c062cd-4f60-470c-b190-7c1b2f32afd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:00.452002 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c062cd-4f60-470c-b190-7c1b2f32afd7 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:00.452296 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c062cd-4f60-470c-b190-7c1b2f32afd7 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:00.452694 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c062cd-4f60-470c-b190-7c1b2f32afd7 None admin] PATH_INFO: `/v3/users/c9fe1d1ff8a24ae28a4a1fc8085a85a1` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:00.458622 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c062cd-4f60-470c-b190-7c1b2f32afd7 None admin] RBAC: Authorizing `identity:get_user(user_id=c9fe1d1ff8a24ae28a4a1fc8085a85a1)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:00.460777 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c062cd-4f60-470c-b190-7c1b2f32afd7 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:00.463642 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 98/203] 10.222.0.136 () {56 vars in 1182 bytes} [Thu Jul 14 17:04:00 2022] GET /identity/v3/users/c9fe1d1ff8a24ae28a4a1fc8085a85a1 => generated 290 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:04:00.468272 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c062cd-4f60-470c-b190-7c1b2f32afd7 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:00.511816 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ca4333-02ed-431c-b0e6-a1a3c20e3cba None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:00.514281 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:00.551640 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d29013-6ee8-4848-9204-6ccbbe26877b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:00.552613 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d29013-6ee8-4848-9204-6ccbbe26877b None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:00.553666 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d29013-6ee8-4848-9204-6ccbbe26877b None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:00.554031 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d29013-6ee8-4848-9204-6ccbbe26877b None admin] PATH_INFO: `/v3/projects/dc58de68345f40498e25fd3ab4626f7f` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:00.555362 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d29013-6ee8-4848-9204-6ccbbe26877b None admin] RBAC: Authorizing `identity:get_project(project_id=dc58de68345f40498e25fd3ab4626f7f)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:00.557006 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d29013-6ee8-4848-9204-6ccbbe26877b None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:00.559627 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 106/204] 10.222.0.136 () {56 vars in 1191 bytes} [Thu Jul 14 17:04:00 2022] GET /identity/v3/projects/dc58de68345f40498e25fd3ab4626f7f => generated 303 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:04:00.566104 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d29013-6ee8-4848-9204-6ccbbe26877b None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:00.668675 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c062cd-4f60-470c-b190-7c1b2f32afd7 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:00.696084 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:00.701020 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d29013-6ee8-4848-9204-6ccbbe26877b None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:00.732457 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50dbd2f-7f57-4499-80f4-9d28036a315f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:00.733130 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50dbd2f-7f57-4499-80f4-9d28036a315f None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:00.733420 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50dbd2f-7f57-4499-80f4-9d28036a315f None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:00.733731 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50dbd2f-7f57-4499-80f4-9d28036a315f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:00.739796 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c703b818-ec76-43f3-8412-404ff47d07a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:00.740797 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c703b818-ec76-43f3-8412-404ff47d07a5 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:00.741264 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c703b818-ec76-43f3-8412-404ff47d07a5 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:00.741765 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c703b818-ec76-43f3-8412-404ff47d07a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:00.742774 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c703b818-ec76-43f3-8412-404ff47d07a5 None admin] RBAC: Adding query filter params (role.id=5e321db416444dc9b5bfce7db763a7ed, scope.project.id=dc58de68345f40498e25fd3ab4626f7f, user.id=962034238a674c5b87a85e8680ea60de) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:04:00.743262 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c703b818-ec76-43f3-8412-404ff47d07a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:00.744888 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c703b818-ec76-43f3-8412-404ff47d07a5 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:00.751557 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 107/205] 10.222.0.136 () {56 vars in 1379 bytes} [Thu Jul 14 17:04:00 2022] GET /identity/v3/role_assignments?user.id=962034238a674c5b87a85e8680ea60de&scope.project.id=dc58de68345f40498e25fd3ab4626f7f&role.id=5e321db416444dc9b5bfce7db763a7ed => generated 260 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 17:04:00.877729 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50dbd2f-7f57-4499-80f4-9d28036a315f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:00.879240 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50dbd2f-7f57-4499-80f4-9d28036a315f None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:00.909681 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:01.007803 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 99/206] 10.222.0.136 () {58 vars in 1287 bytes} [Thu Jul 14 17:04:00 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 540 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 14 17:04:01.014303 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c703b818-ec76-43f3-8412-404ff47d07a5 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:01.149049 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c703b818-ec76-43f3-8412-404ff47d07a5 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:01.198424 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe3d555-9596-4e21-bd73-b0dbbcb2bbe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:01.199728 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe3d555-9596-4e21-bd73-b0dbbcb2bbe0 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:01.200206 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe3d555-9596-4e21-bd73-b0dbbcb2bbe0 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:01.200738 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe3d555-9596-4e21-bd73-b0dbbcb2bbe0 None admin] PATH_INFO: `/v3/projects/8bd70064655e4aa5832910aaa0dd0116` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:01.202211 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe3d555-9596-4e21-bd73-b0dbbcb2bbe0 None admin] RBAC: Authorizing `identity:get_project(project_id=8bd70064655e4aa5832910aaa0dd0116)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:01.203968 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe3d555-9596-4e21-bd73-b0dbbcb2bbe0 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:01.205895 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 108/207] 10.222.0.136 () {56 vars in 1191 bytes} [Thu Jul 14 17:04:01 2022] GET /identity/v3/projects/8bd70064655e4aa5832910aaa0dd0116 => generated 299 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:04:01.213348 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50dbd2f-7f57-4499-80f4-9d28036a315f None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:01.346685 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50dbd2f-7f57-4499-80f4-9d28036a315f None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:01.379123 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:01.402943 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238d53f2-c00d-484c-85e5-ae1e7d55b9eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:01.403632 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238d53f2-c00d-484c-85e5-ae1e7d55b9eb None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:01.403922 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238d53f2-c00d-484c-85e5-ae1e7d55b9eb None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:01.404206 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238d53f2-c00d-484c-85e5-ae1e7d55b9eb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:01.405104 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238d53f2-c00d-484c-85e5-ae1e7d55b9eb None admin] RBAC: Adding query filter params (role.id=2df0ddb31c5141c496d5705ff0dd2bc0, scope.project.id=8bd70064655e4aa5832910aaa0dd0116, user.id=c9fe1d1ff8a24ae28a4a1fc8085a85a1) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:04:01.405424 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238d53f2-c00d-484c-85e5-ae1e7d55b9eb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:01.406949 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238d53f2-c00d-484c-85e5-ae1e7d55b9eb None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:01.416987 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 100/208] 10.222.0.136 () {56 vars in 1379 bytes} [Thu Jul 14 17:04:01 2022] GET /identity/v3/role_assignments?user.id=c9fe1d1ff8a24ae28a4a1fc8085a85a1&scope.project.id=8bd70064655e4aa5832910aaa0dd0116&role.id=2df0ddb31c5141c496d5705ff0dd2bc0 => generated 610 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:04:02.111563 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e32ef01-7f4a-4b2c-93b1-87d20bae1c73 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:02.112123 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e32ef01-7f4a-4b2c-93b1-87d20bae1c73 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:02.112123 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e32ef01-7f4a-4b2c-93b1-87d20bae1c73 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:02.113672 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 109/209] 10.222.0.136 () {54 vars in 931 bytes} [Thu Jul 14 17:04:02 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:04:02.119479 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8723cf32-05fe-4f7f-ab99-06942ef46a01 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:02.120583 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8723cf32-05fe-4f7f-ab99-06942ef46a01 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:02.121093 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8723cf32-05fe-4f7f-ab99-06942ef46a01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:02.142647 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-8723cf32-05fe-4f7f-ab99-06942ef46a01 None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:04:02.144217 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-8723cf32-05fe-4f7f-ab99-06942ef46a01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:04:02.240846 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 101/210] 10.222.0.136 () {58 vars in 1028 bytes} [Thu Jul 14 17:04:02 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 17:04:02.268565 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e32ef01-7f4a-4b2c-93b1-87d20bae1c73 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:02.304426 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:02.312982 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35417609-be4a-4191-a0dc-3b7206bbd2c1 None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:02.313278 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35417609-be4a-4191-a0dc-3b7206bbd2c1 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:02.313573 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35417609-be4a-4191-a0dc-3b7206bbd2c1 None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:02.315214 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 102/211] 10.222.0.136 () {54 vars in 931 bytes} [Thu Jul 14 17:04:02 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 14 17:04:02.323842 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f445a22-472e-418d-aa6f-e48161c9caf5 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:02.324269 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f445a22-472e-418d-aa6f-e48161c9caf5 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:02.324655 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f445a22-472e-418d-aa6f-e48161c9caf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:02.342469 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-2f445a22-472e-418d-aa6f-e48161c9caf5 None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:04:02.343817 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-2f445a22-472e-418d-aa6f-e48161c9caf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:04:02.400849 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e32ef01-7f4a-4b2c-93b1-87d20bae1c73 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:02.418712 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 103/212] 10.222.0.136 () {58 vars in 1028 bytes} [Thu Jul 14 17:04:02 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 17:04:02.440228 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e3b280-49ed-4480-bbba-059787876252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:02.441230 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e3b280-49ed-4480-bbba-059787876252 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:02.441688 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e3b280-49ed-4480-bbba-059787876252 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:02.442133 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e3b280-49ed-4480-bbba-059787876252 None admin] PATH_INFO: `/v3/domains/default` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:02.443536 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e3b280-49ed-4480-bbba-059787876252 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:02.444310 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f445a22-472e-418d-aa6f-e48161c9caf5 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:02.445271 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e3b280-49ed-4480-bbba-059787876252 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:02.447439 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 110/213] 10.222.0.136 () {56 vars in 1113 bytes} [Thu Jul 14 17:04:02 2022] GET /identity/v3/domains/default => generated 200 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:04:02.454450 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e3b280-49ed-4480-bbba-059787876252 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:02.498166 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:02.555314 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f445a22-472e-418d-aa6f-e48161c9caf5 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:02.570242 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:02.575808 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e3b280-49ed-4480-bbba-059787876252 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:02.591934 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f6cf01-3e99-4a22-82d5-8d8089003339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:02.592993 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f6cf01-3e99-4a22-82d5-8d8089003339 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:02.593419 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f6cf01-3e99-4a22-82d5-8d8089003339 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:02.593871 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f6cf01-3e99-4a22-82d5-8d8089003339 None admin] PATH_INFO: `/v3/roles/member` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:02.605347 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f6cf01-3e99-4a22-82d5-8d8089003339 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 17:04:02.614047 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-52f6cf01-3e99-4a22-82d5-8d8089003339 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 17:04:02.614047 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:04:02.614047 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:04:02.614047 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:04:02.614047 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:04:02.614047 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:04:02.614047 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:04:02.614047 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:04:02.614047 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:04:02.614047 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:04:02.614047 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:04:02.614047 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:04:02.614047 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 17:04:02.614047 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 17:04:02.614047 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 17:04:02.614047 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 17:04:02.615099 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 17:04:02.615099 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 17:04:02.615099 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 17:04:02.615099 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 17:04:02.615099 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:04:02.615099 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:04:02.615099 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:04:02.615099 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:04:02.615099 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:04:02.615099 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:04:02.615099 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:04:02.615099 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Jul 14 17:04:02.615099 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:04:02.615099 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:04:02.615099 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:04:02.615099 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:04:02.616612 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:04:02.616612 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:04:02.616612 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:04:02.616612 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:04:02.616612 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 17:04:02.616612 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 17:04:02.616612 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 17:04:02.616612 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 17:04:02.616612 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 17:04:02.616612 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 17:04:02.616612 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 17:04:02.616612 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Jul 14 17:04:02.618114 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6299eac-6dbf-4f99-b8ce-98fce82b1c0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:02.618908 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6299eac-6dbf-4f99-b8ce-98fce82b1c0a None admin] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:02.619274 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 104/214] 10.222.0.136 () {56 vars in 1104 bytes} [Thu Jul 14 17:04:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:04:02.621828 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6299eac-6dbf-4f99-b8ce-98fce82b1c0a None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:02.622262 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6299eac-6dbf-4f99-b8ce-98fce82b1c0a None admin] PATH_INFO: `/v3/users` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:02.623107 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6299eac-6dbf-4f99-b8ce-98fce82b1c0a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:02.624717 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f6cf01-3e99-4a22-82d5-8d8089003339 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:02.626798 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6299eac-6dbf-4f99-b8ce-98fce82b1c0a None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:02.662848 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 111/215] 10.222.0.136 () {60 vars in 1137 bytes} [Thu Jul 14 17:04:02 2022] POST /identity/v3/users => generated 298 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 17:04:02.746693 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f6cf01-3e99-4a22-82d5-8d8089003339 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:02.750232 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:02.786133 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a366e095-192f-42c8-9176-06ceaa24a493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:02.787123 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a366e095-192f-42c8-9176-06ceaa24a493 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:02.788289 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a366e095-192f-42c8-9176-06ceaa24a493 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:02.788853 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a366e095-192f-42c8-9176-06ceaa24a493 None admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:02.789816 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a366e095-192f-42c8-9176-06ceaa24a493 None admin] RBAC: Adding query filter params (name=member) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:04:02.790298 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a366e095-192f-42c8-9176-06ceaa24a493 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:02.791895 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a366e095-192f-42c8-9176-06ceaa24a493 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:02.801669 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 105/216] 10.222.0.136 () {56 vars in 1106 bytes} [Thu Jul 14 17:04:02 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:04:02.811025 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6299eac-6dbf-4f99-b8ce-98fce82b1c0a None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:02.932983 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6299eac-6dbf-4f99-b8ce-98fce82b1c0a None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:02.970173 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fcbb55-9265-4c48-9b4b-5670cfaaeffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:02.971048 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fcbb55-9265-4c48-9b4b-5670cfaaeffc None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:02.971325 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fcbb55-9265-4c48-9b4b-5670cfaaeffc None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:02.971597 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fcbb55-9265-4c48-9b4b-5670cfaaeffc None admin] PATH_INFO: `/v3/users/f441e5f699c64526983207cb4181c564` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:02.987233 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fcbb55-9265-4c48-9b4b-5670cfaaeffc None admin] RBAC: Authorizing `identity:get_user(user_id=f441e5f699c64526983207cb4181c564)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:02.988693 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fcbb55-9265-4c48-9b4b-5670cfaaeffc None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:02.991106 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 112/217] 10.222.0.136 () {56 vars in 1182 bytes} [Thu Jul 14 17:04:02 2022] GET /identity/v3/users/f441e5f699c64526983207cb4181c564 => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:04:02.996842 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a366e095-192f-42c8-9176-06ceaa24a493 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:03.027931 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df62cb0a-1a63-4c10-8dc2-e0f71c6a5a5d None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:03.028230 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df62cb0a-1a63-4c10-8dc2-e0f71c6a5a5d None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:03.028497 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df62cb0a-1a63-4c10-8dc2-e0f71c6a5a5d None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:03.030043 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 113/218] 10.222.0.136 () {54 vars in 931 bytes} [Thu Jul 14 17:04:03 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 14 17:04:03.035586 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0083380-f57d-4005-8a15-af084de9bd69 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:03.035877 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0083380-f57d-4005-8a15-af084de9bd69 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:03.036164 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0083380-f57d-4005-8a15-af084de9bd69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:03.058211 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-a0083380-f57d-4005-8a15-af084de9bd69 None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:04:03.059518 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-a0083380-f57d-4005-8a15-af084de9bd69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:04:03.072704 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:03.133236 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a366e095-192f-42c8-9176-06ceaa24a493 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:03.151043 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 114/219] 10.222.0.136 () {58 vars in 1028 bytes} [Thu Jul 14 17:04:03 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 17:04:03.177122 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0083380-f57d-4005-8a15-af084de9bd69 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:03.190677 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bf96b4-662e-4a36-a719-0fa22e44066c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:03.198259 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bf96b4-662e-4a36-a719-0fa22e44066c None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:03.199066 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bf96b4-662e-4a36-a719-0fa22e44066c None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:03.199365 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bf96b4-662e-4a36-a719-0fa22e44066c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:03.254057 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:03.305283 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0083380-f57d-4005-8a15-af084de9bd69 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:03.308470 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bf96b4-662e-4a36-a719-0fa22e44066c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:03.310257 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bf96b4-662e-4a36-a719-0fa22e44066c None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:03.350833 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7dee29-59b2-4afc-b3cd-592321a67f8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:03.351666 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7dee29-59b2-4afc-b3cd-592321a67f8e None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:03.351956 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7dee29-59b2-4afc-b3cd-592321a67f8e None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:03.352239 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7dee29-59b2-4afc-b3cd-592321a67f8e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:03.382257 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7dee29-59b2-4afc-b3cd-592321a67f8e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 17:04:03.394630 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-ac7dee29-59b2-4afc-b3cd-592321a67f8e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 17:04:03.394630 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:04:03.394630 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:04:03.394630 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:04:03.394630 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:04:03.394630 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:04:03.394630 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:04:03.394630 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:04:03.394630 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:04:03.394630 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:04:03.394630 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:04:03.394630 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:04:03.394630 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 17:04:03.394630 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 17:04:03.394630 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 17:04:03.394630 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 17:04:03.395777 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 17:04:03.395777 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 17:04:03.395777 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 17:04:03.395777 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 17:04:03.395777 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:04:03.395777 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:04:03.395777 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:04:03.395777 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:04:03.395777 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:04:03.395777 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:04:03.395777 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:04:03.395777 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Jul 14 17:04:03.395777 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:04:03.395777 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:04:03.395777 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:04:03.395777 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:04:03.397264 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:04:03.397264 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:04:03.397264 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:04:03.397264 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:04:03.397264 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 17:04:03.397264 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 17:04:03.397264 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 17:04:03.397264 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 17:04:03.397264 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 17:04:03.397264 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 17:04:03.397264 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 17:04:03.397264 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Jul 14 17:04:03.403791 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 115/220] 10.222.0.136 () {56 vars in 1101 bytes} [Thu Jul 14 17:04:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 17:04:03.405398 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7dee29-59b2-4afc-b3cd-592321a67f8e None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:03.410480 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:03.489770 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 106/221] 10.222.0.136 () {58 vars in 1287 bytes} [Thu Jul 14 17:04:02 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 17:04:03.495943 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bf96b4-662e-4a36-a719-0fa22e44066c None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:03.545330 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7dee29-59b2-4afc-b3cd-592321a67f8e None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:03.576812 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:03.584819 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c419d9-7ddb-412d-ac04-46cb3b193120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:03.585605 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c419d9-7ddb-412d-ac04-46cb3b193120 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:03.585899 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c419d9-7ddb-412d-ac04-46cb3b193120 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:03.586182 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c419d9-7ddb-412d-ac04-46cb3b193120 None admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:03.586947 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c419d9-7ddb-412d-ac04-46cb3b193120 None admin] RBAC: Adding query filter params (name=admin) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:04:03.587259 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c419d9-7ddb-412d-ac04-46cb3b193120 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:03.588757 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c419d9-7ddb-412d-ac04-46cb3b193120 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:03.597910 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 116/222] 10.222.0.136 () {56 vars in 1104 bytes} [Thu Jul 14 17:04:03 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:04:03.604374 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b17a962-49aa-4368-ad20-288760510570 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:03.604674 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b17a962-49aa-4368-ad20-288760510570 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:03.604963 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b17a962-49aa-4368-ad20-288760510570 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:03.607363 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 117/223] 10.222.0.136 () {54 vars in 931 bytes} [Thu Jul 14 17:04:03 2022] GET /identity => generated 271 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:04:03.608185 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b17a962-49aa-4368-ad20-288760510570 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:03.621407 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bf96b4-662e-4a36-a719-0fa22e44066c None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:03.661170 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a001195-099a-4a10-a73b-e119f156150e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:03.662759 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a001195-099a-4a10-a73b-e119f156150e None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:03.663306 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a001195-099a-4a10-a73b-e119f156150e None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:03.663593 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a001195-099a-4a10-a73b-e119f156150e None admin] PATH_INFO: `/v3/projects/dc58de68345f40498e25fd3ab4626f7f` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:03.664920 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a001195-099a-4a10-a73b-e119f156150e None admin] RBAC: Authorizing `identity:get_project(project_id=dc58de68345f40498e25fd3ab4626f7f)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:03.666606 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a001195-099a-4a10-a73b-e119f156150e None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:03.668379 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 107/224] 10.222.0.136 () {56 vars in 1191 bytes} [Thu Jul 14 17:04:03 2022] GET /identity/v3/projects/dc58de68345f40498e25fd3ab4626f7f => generated 303 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 17:04:03.669796 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970bfcfb-bb6a-4269-b0cb-05ff63484664 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:03.670107 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970bfcfb-bb6a-4269-b0cb-05ff63484664 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:03.670356 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970bfcfb-bb6a-4269-b0cb-05ff63484664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:03.676312 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:03.692622 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-970bfcfb-bb6a-4269-b0cb-05ff63484664 None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:04:03.695138 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-970bfcfb-bb6a-4269-b0cb-05ff63484664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:04:03.718758 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b17a962-49aa-4368-ad20-288760510570 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:03.756945 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432a59cf-3ed9-4b38-879c-07423cb18525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:03.758108 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432a59cf-3ed9-4b38-879c-07423cb18525 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:03.758390 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432a59cf-3ed9-4b38-879c-07423cb18525 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:03.758670 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432a59cf-3ed9-4b38-879c-07423cb18525 None admin] PATH_INFO: `/v3/users/962034238a674c5b87a85e8680ea60de` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:03.760014 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432a59cf-3ed9-4b38-879c-07423cb18525 None admin] RBAC: Authorizing `identity:get_user(user_id=962034238a674c5b87a85e8680ea60de)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:03.761563 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432a59cf-3ed9-4b38-879c-07423cb18525 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:03.769113 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 118/225] 10.222.0.136 () {56 vars in 1182 bytes} [Thu Jul 14 17:04:03 2022] GET /identity/v3/users/962034238a674c5b87a85e8680ea60de => generated 284 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:04:03.770057 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432a59cf-3ed9-4b38-879c-07423cb18525 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:03.781232 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 108/226] 10.222.0.136 () {58 vars in 1028 bytes} [Thu Jul 14 17:04:03 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 17:04:03.789751 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970bfcfb-bb6a-4269-b0cb-05ff63484664 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:03.872364 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:03.885261 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432a59cf-3ed9-4b38-879c-07423cb18525 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:03.916620 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970bfcfb-bb6a-4269-b0cb-05ff63484664 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:03.929738 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb94c92-f0ce-4c91-bab7-250f98bf6826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:03.931188 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb94c92-f0ce-4c91-bab7-250f98bf6826 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:03.933723 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:03.934899 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb94c92-f0ce-4c91-bab7-250f98bf6826 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:03.935373 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb94c92-f0ce-4c91-bab7-250f98bf6826 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:03.937306 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb94c92-f0ce-4c91-bab7-250f98bf6826 None admin] RBAC: Adding query filter params (role.id=7441b1b1ab104537addd90a2471822f3, scope.project.id=dc58de68345f40498e25fd3ab4626f7f, user.id=f441e5f699c64526983207cb4181c564) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:04:03.938044 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb94c92-f0ce-4c91-bab7-250f98bf6826 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:03.940099 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb94c92-f0ce-4c91-bab7-250f98bf6826 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:03.948549 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 119/227] 10.222.0.136 () {56 vars in 1379 bytes} [Thu Jul 14 17:04:03 2022] GET /identity/v3/role_assignments?user.id=f441e5f699c64526983207cb4181c564&scope.project.id=dc58de68345f40498e25fd3ab4626f7f&role.id=7441b1b1ab104537addd90a2471822f3 => generated 260 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:04:03.949854 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb94c92-f0ce-4c91-bab7-250f98bf6826 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:03.967034 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0f328a-8815-4253-9e5d-9a74be122928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:03.967978 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0f328a-8815-4253-9e5d-9a74be122928 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:03.968274 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0f328a-8815-4253-9e5d-9a74be122928 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:03.968594 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0f328a-8815-4253-9e5d-9a74be122928 None admin] PATH_INFO: `/v3/projects/dc58de68345f40498e25fd3ab4626f7f` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:03.969897 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0f328a-8815-4253-9e5d-9a74be122928 None admin] RBAC: Authorizing `identity:get_project(project_id=dc58de68345f40498e25fd3ab4626f7f)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:03.971419 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0f328a-8815-4253-9e5d-9a74be122928 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:03.973205 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 109/228] 10.222.0.136 () {56 vars in 1191 bytes} [Thu Jul 14 17:04:03 2022] GET /identity/v3/projects/dc58de68345f40498e25fd3ab4626f7f => generated 303 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:04:03.979722 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0f328a-8815-4253-9e5d-9a74be122928 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:04.084471 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb94c92-f0ce-4c91-bab7-250f98bf6826 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:04.144595 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20edbd4c-edf2-413d-9cdf-739bcb1bd694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:04.146383 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20edbd4c-edf2-413d-9cdf-739bcb1bd694 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:04.147671 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20edbd4c-edf2-413d-9cdf-739bcb1bd694 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:04.148423 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20edbd4c-edf2-413d-9cdf-739bcb1bd694 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:04.166611 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20edbd4c-edf2-413d-9cdf-739bcb1bd694 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 17:04:04.179519 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-20edbd4c-edf2-413d-9cdf-739bcb1bd694 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 17:04:04.179519 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:04:04.179519 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:04:04.179519 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:04:04.179519 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:04:04.179519 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:04:04.179519 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:04:04.179519 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:04:04.179519 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:04:04.179519 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:04:04.179519 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:04:04.179519 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:04:04.179519 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 17:04:04.179519 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 17:04:04.179519 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 17:04:04.179519 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 17:04:04.180484 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 17:04:04.180484 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 17:04:04.180484 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 17:04:04.180484 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 17:04:04.180484 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:04:04.180484 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:04:04.180484 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:04:04.180484 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:04:04.180484 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:04:04.180484 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:04:04.180484 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:04:04.180484 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Jul 14 17:04:04.180484 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:04:04.180484 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:04:04.180484 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:04:04.180484 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:04:04.181278 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:04:04.181278 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:04:04.181278 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:04:04.181278 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:04:04.181278 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 17:04:04.181278 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 17:04:04.181278 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 17:04:04.181278 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 17:04:04.181278 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 17:04:04.181278 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 17:04:04.181278 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 17:04:04.181278 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Jul 14 17:04:04.184473 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 120/229] 10.222.0.136 () {56 vars in 1119 bytes} [Thu Jul 14 17:04:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:04:04.190666 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20edbd4c-edf2-413d-9cdf-739bcb1bd694 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:04.223526 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0f328a-8815-4253-9e5d-9a74be122928 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:04.260422 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:04.266835 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edff7031-64bc-42e2-8737-4f89dac761c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:04.268020 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edff7031-64bc-42e2-8737-4f89dac761c0 None admin] REQUEST_METHOD: `PUT` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:04.268498 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edff7031-64bc-42e2-8737-4f89dac761c0 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:04.268955 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edff7031-64bc-42e2-8737-4f89dac761c0 None admin] PATH_INFO: `/v3/projects/dc58de68345f40498e25fd3ab4626f7f/users/962034238a674c5b87a85e8680ea60de/roles/284c6314b4d3492085e397a87b0e3b51` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:04.271311 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edff7031-64bc-42e2-8737-4f89dac761c0 None admin] RBAC: Authorizing `identity:create_grant(project_id=dc58de68345f40498e25fd3ab4626f7f, user_id=962034238a674c5b87a85e8680ea60de, role_id=284c6314b4d3492085e397a87b0e3b51)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:04.274653 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edff7031-64bc-42e2-8737-4f89dac761c0 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:04.289927 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 110/230] 10.222.0.136 () {58 vars in 1444 bytes} [Thu Jul 14 17:04:03 2022] PUT /identity/v3/projects/dc58de68345f40498e25fd3ab4626f7f/users/962034238a674c5b87a85e8680ea60de/roles/284c6314b4d3492085e397a87b0e3b51 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:04:04.329593 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:04.394390 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20edbd4c-edf2-413d-9cdf-739bcb1bd694 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:04.448503 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9c455e-bc4f-4c13-8948-85cf94f6982d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:04.449293 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9c455e-bc4f-4c13-8948-85cf94f6982d None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:04.449605 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9c455e-bc4f-4c13-8948-85cf94f6982d None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:04.449941 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9c455e-bc4f-4c13-8948-85cf94f6982d None admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:04.450711 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9c455e-bc4f-4c13-8948-85cf94f6982d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:04:04.451020 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9c455e-bc4f-4c13-8948-85cf94f6982d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:04.452412 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9c455e-bc4f-4c13-8948-85cf94f6982d None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:04.464744 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 121/231] 10.222.0.136 () {56 vars in 1116 bytes} [Thu Jul 14 17:04:04 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:04:04.470620 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edff7031-64bc-42e2-8737-4f89dac761c0 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:04.606224 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edff7031-64bc-42e2-8737-4f89dac761c0 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:04.643374 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771a6491-d5f5-409b-b99b-945b7dd67c5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:04.644688 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771a6491-d5f5-409b-b99b-945b7dd67c5f None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:04.645199 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771a6491-d5f5-409b-b99b-945b7dd67c5f None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:04.645663 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771a6491-d5f5-409b-b99b-945b7dd67c5f None admin] PATH_INFO: `/v3/users/962034238a674c5b87a85e8680ea60de` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:04.647820 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771a6491-d5f5-409b-b99b-945b7dd67c5f None admin] RBAC: Authorizing `identity:get_user(user_id=962034238a674c5b87a85e8680ea60de)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:04.649457 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771a6491-d5f5-409b-b99b-945b7dd67c5f None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:04.651294 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 111/232] 10.222.0.136 () {56 vars in 1182 bytes} [Thu Jul 14 17:04:04 2022] GET /identity/v3/users/962034238a674c5b87a85e8680ea60de => generated 284 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:04:04.656916 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9c455e-bc4f-4c13-8948-85cf94f6982d None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:04.812329 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9c455e-bc4f-4c13-8948-85cf94f6982d None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:04.838392 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:04.859214 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc5ef84-a579-4797-bccb-d1f82a7960bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:04.860081 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc5ef84-a579-4797-bccb-d1f82a7960bf None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:04.860373 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc5ef84-a579-4797-bccb-d1f82a7960bf None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:04.860652 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc5ef84-a579-4797-bccb-d1f82a7960bf None admin] PATH_INFO: `/v3/projects/dc58de68345f40498e25fd3ab4626f7f` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:04.866492 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc5ef84-a579-4797-bccb-d1f82a7960bf None admin] RBAC: Authorizing `identity:get_project(project_id=dc58de68345f40498e25fd3ab4626f7f)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:04.867972 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc5ef84-a579-4797-bccb-d1f82a7960bf None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:04.869757 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 122/233] 10.222.0.136 () {56 vars in 1191 bytes} [Thu Jul 14 17:04:04 2022] GET /identity/v3/projects/dc58de68345f40498e25fd3ab4626f7f => generated 303 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:04:04.875563 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771a6491-d5f5-409b-b99b-945b7dd67c5f None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:04.976511 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:05.030414 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771a6491-d5f5-409b-b99b-945b7dd67c5f None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:05.079944 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805d9064-996f-46f5-b501-27e1fd809241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:05.080861 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805d9064-996f-46f5-b501-27e1fd809241 None admin] REQUEST_METHOD: `PUT` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:05.081148 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805d9064-996f-46f5-b501-27e1fd809241 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:05.081427 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805d9064-996f-46f5-b501-27e1fd809241 None admin] PATH_INFO: `/v3/projects/dc58de68345f40498e25fd3ab4626f7f/users/962034238a674c5b87a85e8680ea60de/roles/5e321db416444dc9b5bfce7db763a7ed` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:05.083777 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805d9064-996f-46f5-b501-27e1fd809241 None admin] RBAC: Authorizing `identity:create_grant(project_id=dc58de68345f40498e25fd3ab4626f7f, user_id=962034238a674c5b87a85e8680ea60de, role_id=5e321db416444dc9b5bfce7db763a7ed)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:05.085363 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805d9064-996f-46f5-b501-27e1fd809241 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:05.123423 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 112/234] 10.222.0.136 () {58 vars in 1444 bytes} [Thu Jul 14 17:04:04 2022] PUT /identity/v3/projects/dc58de68345f40498e25fd3ab4626f7f/users/962034238a674c5b87a85e8680ea60de/roles/5e321db416444dc9b5bfce7db763a7ed => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:04:05.610871 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c482de6-24bd-459b-8a41-3f68397de2c3 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:05.611386 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c482de6-24bd-459b-8a41-3f68397de2c3 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:05.611462 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c482de6-24bd-459b-8a41-3f68397de2c3 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:05.612971 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 123/235] 10.222.0.136 () {54 vars in 931 bytes} [Thu Jul 14 17:04:05 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:04:05.619144 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737320d3-5314-4d06-abee-f0a093c1916f None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:05.619573 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737320d3-5314-4d06-abee-f0a093c1916f None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:05.619769 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737320d3-5314-4d06-abee-f0a093c1916f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:05.641677 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-737320d3-5314-4d06-abee-f0a093c1916f None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:04:05.642888 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-737320d3-5314-4d06-abee-f0a093c1916f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:04:05.735647 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 113/236] 10.222.0.136 () {58 vars in 1028 bytes} [Thu Jul 14 17:04:05 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 17:04:05.779172 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c482de6-24bd-459b-8a41-3f68397de2c3 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:05.943219 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c482de6-24bd-459b-8a41-3f68397de2c3 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:05.997354 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3cb46f-eae4-4503-9ed6-003e7a047894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:05.998202 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3cb46f-eae4-4503-9ed6-003e7a047894 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:05.998490 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3cb46f-eae4-4503-9ed6-003e7a047894 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:05.998769 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3cb46f-eae4-4503-9ed6-003e7a047894 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:06.011030 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3cb46f-eae4-4503-9ed6-003e7a047894 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 17:04:06.019371 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-2d3cb46f-eae4-4503-9ed6-003e7a047894 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 17:04:06.019371 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:04:06.019371 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:04:06.019371 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:04:06.019371 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:04:06.019371 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:04:06.019371 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:04:06.019371 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:04:06.019371 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:04:06.019371 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:04:06.019371 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:04:06.019371 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:04:06.019371 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 17:04:06.019371 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 17:04:06.019371 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 17:04:06.019371 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 17:04:06.020279 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 17:04:06.020279 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 17:04:06.020279 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 17:04:06.020279 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 17:04:06.020279 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:04:06.020279 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:04:06.020279 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:04:06.020279 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:04:06.020279 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:04:06.020279 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:04:06.020279 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:04:06.020279 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Jul 14 17:04:06.020279 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:04:06.020279 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:04:06.020279 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:04:06.020279 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:04:06.021091 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:04:06.021091 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:04:06.021091 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:04:06.021091 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:04:06.021091 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 17:04:06.021091 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 17:04:06.021091 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 17:04:06.021091 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 17:04:06.021091 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 17:04:06.021091 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 17:04:06.021091 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 17:04:06.021091 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Jul 14 17:04:06.021091 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 124/237] 10.222.0.136 () {56 vars in 1104 bytes} [Thu Jul 14 17:04:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:04:06.029691 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737320d3-5314-4d06-abee-f0a093c1916f None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:06.045436 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5752087b-8495-4112-9e88-04980aa21efc None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:06.045775 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5752087b-8495-4112-9e88-04980aa21efc None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:06.046030 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5752087b-8495-4112-9e88-04980aa21efc None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:06.048912 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 125/238] 10.222.0.136 () {54 vars in 931 bytes} [Thu Jul 14 17:04:06 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 14 17:04:06.058243 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b5f04d-0fd3-4c26-a0e6-ecacf0d5ded8 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:06.058243 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b5f04d-0fd3-4c26-a0e6-ecacf0d5ded8 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:06.058243 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b5f04d-0fd3-4c26-a0e6-ecacf0d5ded8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:06.077816 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-58b5f04d-0fd3-4c26-a0e6-ecacf0d5ded8 None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:04:06.079354 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-58b5f04d-0fd3-4c26-a0e6-ecacf0d5ded8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:04:06.158974 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:06.163220 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:06.225663 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 126/239] 10.222.0.136 () {58 vars in 1028 bytes} [Thu Jul 14 17:04:06 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 17:04:06.282051 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737320d3-5314-4d06-abee-f0a093c1916f None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:06.284905 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b5f04d-0fd3-4c26-a0e6-ecacf0d5ded8 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:06.374522 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf2c9aa-d772-4574-ae6d-db8b0343a567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:06.375228 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf2c9aa-d772-4574-ae6d-db8b0343a567 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:06.375518 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf2c9aa-d772-4574-ae6d-db8b0343a567 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:06.375800 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf2c9aa-d772-4574-ae6d-db8b0343a567 None admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:06.376566 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf2c9aa-d772-4574-ae6d-db8b0343a567 None admin] RBAC: Adding query filter params (name=reader) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:04:06.376883 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf2c9aa-d772-4574-ae6d-db8b0343a567 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:06.382877 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf2c9aa-d772-4574-ae6d-db8b0343a567 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:06.396110 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 114/240] 10.222.0.136 () {56 vars in 1106 bytes} [Thu Jul 14 17:04:06 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:04:06.405477 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf2c9aa-d772-4574-ae6d-db8b0343a567 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:06.431618 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b5f04d-0fd3-4c26-a0e6-ecacf0d5ded8 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:06.474074 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5692bd74-0692-447f-b62e-6d9a593e4d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:06.475468 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5692bd74-0692-447f-b62e-6d9a593e4d22 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:06.475777 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5692bd74-0692-447f-b62e-6d9a593e4d22 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:06.476030 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5692bd74-0692-447f-b62e-6d9a593e4d22 None admin] PATH_INFO: `/v3/domains/default` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:06.477233 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5692bd74-0692-447f-b62e-6d9a593e4d22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:06.479334 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5692bd74-0692-447f-b62e-6d9a593e4d22 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:06.481176 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 127/241] 10.222.0.136 () {56 vars in 1113 bytes} [Thu Jul 14 17:04:06 2022] GET /identity/v3/domains/default => generated 200 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 17:04:06.487758 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5692bd74-0692-447f-b62e-6d9a593e4d22 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:06.556546 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:06.628454 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5692bd74-0692-447f-b62e-6d9a593e4d22 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:06.674890 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610af873-9b82-40d0-8866-0e0a92a88809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:06.675578 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610af873-9b82-40d0-8866-0e0a92a88809 None admin] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:06.675866 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610af873-9b82-40d0-8866-0e0a92a88809 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:06.676254 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610af873-9b82-40d0-8866-0e0a92a88809 None admin] PATH_INFO: `/v3/users` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:06.677002 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610af873-9b82-40d0-8866-0e0a92a88809 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:06.679242 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610af873-9b82-40d0-8866-0e0a92a88809 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:06.714417 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 128/242] 10.222.0.136 () {60 vars in 1137 bytes} [Thu Jul 14 17:04:06 2022] POST /identity/v3/users => generated 294 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 17:04:06.756935 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf2c9aa-d772-4574-ae6d-db8b0343a567 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:06.790033 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:06.830470 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f8ab0d-1a66-493e-aff2-df6903113737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:06.831388 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f8ab0d-1a66-493e-aff2-df6903113737 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:06.831672 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f8ab0d-1a66-493e-aff2-df6903113737 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:06.831946 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f8ab0d-1a66-493e-aff2-df6903113737 None admin] PATH_INFO: `/v3/users/108d6d251cf74b26ad46d7d78d319f1c` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:06.852405 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f8ab0d-1a66-493e-aff2-df6903113737 None admin] RBAC: Authorizing `identity:get_user(user_id=108d6d251cf74b26ad46d7d78d319f1c)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:06.853931 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f8ab0d-1a66-493e-aff2-df6903113737 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:06.855704 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 115/243] 10.222.0.136 () {56 vars in 1182 bytes} [Thu Jul 14 17:04:06 2022] GET /identity/v3/users/108d6d251cf74b26ad46d7d78d319f1c => generated 298 bytes in 451 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:04:06.862063 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610af873-9b82-40d0-8866-0e0a92a88809 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:07.009032 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ac0848-f3c9-494d-ae49-5e3db79f5aa1 None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:07.009331 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ac0848-f3c9-494d-ae49-5e3db79f5aa1 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:07.009496 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ac0848-f3c9-494d-ae49-5e3db79f5aa1 None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:07.011258 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 116/244] 10.222.0.136 () {54 vars in 931 bytes} [Thu Jul 14 17:04:07 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 14 17:04:07.016921 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d8ef53-ebd1-470f-aa1a-1644cf095856 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:07.017205 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d8ef53-ebd1-470f-aa1a-1644cf095856 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:07.017491 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d8ef53-ebd1-470f-aa1a-1644cf095856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:07.019263 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:07.022682 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610af873-9b82-40d0-8866-0e0a92a88809 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:07.049076 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-11d8ef53-ebd1-470f-aa1a-1644cf095856 None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:04:07.051253 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-11d8ef53-ebd1-470f-aa1a-1644cf095856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:04:07.073458 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46b2065-a181-412d-94f0-04994b47a16e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:07.074199 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46b2065-a181-412d-94f0-04994b47a16e None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:07.074488 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46b2065-a181-412d-94f0-04994b47a16e None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:07.074770 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46b2065-a181-412d-94f0-04994b47a16e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:07.152420 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 117/245] 10.222.0.136 () {58 vars in 1028 bytes} [Thu Jul 14 17:04:07 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 17:04:07.166371 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46b2065-a181-412d-94f0-04994b47a16e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:07.168173 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46b2065-a181-412d-94f0-04994b47a16e None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:07.179717 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d8ef53-ebd1-470f-aa1a-1644cf095856 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:07.298920 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:07.305406 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 129/246] 10.222.0.136 () {58 vars in 1287 bytes} [Thu Jul 14 17:04:06 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 17:04:07.307211 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a9c34f-8dfc-47a2-bf2a-3d8c887eddd1 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:07.307576 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a9c34f-8dfc-47a2-bf2a-3d8c887eddd1 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:07.307928 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a9c34f-8dfc-47a2-bf2a-3d8c887eddd1 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:07.309393 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 130/247] 10.222.0.136 () {54 vars in 931 bytes} [Thu Jul 14 17:04:07 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:04:07.313976 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:07.315162 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a9c34f-8dfc-47a2-bf2a-3d8c887eddd1 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:07.316955 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d8ef53-ebd1-470f-aa1a-1644cf095856 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:07.368768 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d612801-ca89-407c-b271-1da4cf522cd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:07.369673 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d612801-ca89-407c-b271-1da4cf522cd3 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:07.369969 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d612801-ca89-407c-b271-1da4cf522cd3 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:07.370253 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d612801-ca89-407c-b271-1da4cf522cd3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:07.385114 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d612801-ca89-407c-b271-1da4cf522cd3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 17:04:07.393061 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-6d612801-ca89-407c-b271-1da4cf522cd3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 17:04:07.393061 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:04:07.393061 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:04:07.393061 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:04:07.393061 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:04:07.393061 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:04:07.393061 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:04:07.393061 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:04:07.393061 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:04:07.393061 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:04:07.393061 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:04:07.393061 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:04:07.393061 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 17:04:07.393061 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 17:04:07.393061 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 17:04:07.393061 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 17:04:07.394007 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 17:04:07.394007 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 17:04:07.394007 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 17:04:07.394007 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 17:04:07.394007 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:04:07.394007 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:04:07.394007 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:04:07.394007 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:04:07.394007 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:04:07.394007 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:04:07.394007 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:04:07.394007 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Jul 14 17:04:07.394007 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:04:07.394007 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:04:07.394007 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:04:07.394007 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:04:07.395560 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:04:07.395560 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:04:07.395560 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:04:07.395560 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:04:07.395560 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 17:04:07.395560 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 17:04:07.395560 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 17:04:07.395560 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 17:04:07.395560 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 17:04:07.395560 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 17:04:07.395560 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 17:04:07.395560 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Jul 14 17:04:07.395560 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 118/248] 10.222.0.136 () {56 vars in 1104 bytes} [Thu Jul 14 17:04:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:04:07.396374 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad12f25-aa41-45ad-81e2-a26f07878d74 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:07.396441 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad12f25-aa41-45ad-81e2-a26f07878d74 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:07.396807 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad12f25-aa41-45ad-81e2-a26f07878d74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:07.419951 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-6ad12f25-aa41-45ad-81e2-a26f07878d74 None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:04:07.420732 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-6ad12f25-aa41-45ad-81e2-a26f07878d74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:04:07.453321 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a9c34f-8dfc-47a2-bf2a-3d8c887eddd1 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:07.500800 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cd8690-e957-4b0e-8b4e-eb408a6409f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:07.501955 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cd8690-e957-4b0e-8b4e-eb408a6409f5 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:07.502239 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cd8690-e957-4b0e-8b4e-eb408a6409f5 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:07.502515 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cd8690-e957-4b0e-8b4e-eb408a6409f5 None admin] PATH_INFO: `/v3/projects/dc58de68345f40498e25fd3ab4626f7f` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:07.503739 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cd8690-e957-4b0e-8b4e-eb408a6409f5 None admin] RBAC: Authorizing `identity:get_project(project_id=dc58de68345f40498e25fd3ab4626f7f)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:07.505031 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 119/249] 10.222.0.136 () {58 vars in 1028 bytes} [Thu Jul 14 17:04:07 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 17:04:07.505505 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cd8690-e957-4b0e-8b4e-eb408a6409f5 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:07.506445 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad12f25-aa41-45ad-81e2-a26f07878d74 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:07.508178 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 131/250] 10.222.0.136 () {56 vars in 1191 bytes} [Thu Jul 14 17:04:07 2022] GET /identity/v3/projects/dc58de68345f40498e25fd3ab4626f7f => generated 303 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:04:07.514974 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cd8690-e957-4b0e-8b4e-eb408a6409f5 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:07.641032 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:07.690829 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:07.698529 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cd8690-e957-4b0e-8b4e-eb408a6409f5 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:07.714031 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad12f25-aa41-45ad-81e2-a26f07878d74 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:07.769755 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae83f20d-b526-47ca-9288-1ea77f963116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:07.770426 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae83f20d-b526-47ca-9288-1ea77f963116 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:07.770712 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae83f20d-b526-47ca-9288-1ea77f963116 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:07.771001 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae83f20d-b526-47ca-9288-1ea77f963116 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:07.772673 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae83f20d-b526-47ca-9288-1ea77f963116 None admin] RBAC: Adding query filter params (role.id=2df0ddb31c5141c496d5705ff0dd2bc0, scope.project.id=dc58de68345f40498e25fd3ab4626f7f, user.id=108d6d251cf74b26ad46d7d78d319f1c) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:04:07.772673 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae83f20d-b526-47ca-9288-1ea77f963116 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:07.774174 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae83f20d-b526-47ca-9288-1ea77f963116 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:07.780511 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36cf852-80db-4005-aa3d-ddf2e2318eed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:07.781203 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36cf852-80db-4005-aa3d-ddf2e2318eed None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:07.781491 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36cf852-80db-4005-aa3d-ddf2e2318eed None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:07.781795 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36cf852-80db-4005-aa3d-ddf2e2318eed None admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:07.782550 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36cf852-80db-4005-aa3d-ddf2e2318eed None admin] RBAC: Adding query filter params (name=member) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:04:07.782868 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36cf852-80db-4005-aa3d-ddf2e2318eed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:07.784257 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36cf852-80db-4005-aa3d-ddf2e2318eed None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:07.791656 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 132/251] 10.222.0.136 () {56 vars in 1379 bytes} [Thu Jul 14 17:04:07 2022] GET /identity/v3/role_assignments?user.id=108d6d251cf74b26ad46d7d78d319f1c&scope.project.id=dc58de68345f40498e25fd3ab4626f7f&role.id=2df0ddb31c5141c496d5705ff0dd2bc0 => generated 260 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:04:07.792508 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae83f20d-b526-47ca-9288-1ea77f963116 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:07.803536 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 120/252] 10.222.0.136 () {56 vars in 1106 bytes} [Thu Jul 14 17:04:07 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:04:07.810482 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36cf852-80db-4005-aa3d-ddf2e2318eed None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:07.997680 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36cf852-80db-4005-aa3d-ddf2e2318eed None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:08.049321 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d114c39-0f5d-406c-9efa-c4b46f47c3b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:08.050261 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d114c39-0f5d-406c-9efa-c4b46f47c3b2 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:08.050553 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d114c39-0f5d-406c-9efa-c4b46f47c3b2 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:08.050838 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d114c39-0f5d-406c-9efa-c4b46f47c3b2 None admin] PATH_INFO: `/v3/users/f441e5f699c64526983207cb4181c564` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:08.052065 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d114c39-0f5d-406c-9efa-c4b46f47c3b2 None admin] RBAC: Authorizing `identity:get_user(user_id=f441e5f699c64526983207cb4181c564)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:08.053896 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d114c39-0f5d-406c-9efa-c4b46f47c3b2 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:08.055962 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 121/253] 10.222.0.136 () {56 vars in 1182 bytes} [Thu Jul 14 17:04:07 2022] GET /identity/v3/users/f441e5f699c64526983207cb4181c564 => generated 298 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:04:08.061074 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d114c39-0f5d-406c-9efa-c4b46f47c3b2 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:08.085490 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae83f20d-b526-47ca-9288-1ea77f963116 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:08.105002 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:08.152745 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:08.161491 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494e8ec9-af2e-48a6-b88e-f0dee62b8238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:08.163911 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494e8ec9-af2e-48a6-b88e-f0dee62b8238 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:08.164211 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494e8ec9-af2e-48a6-b88e-f0dee62b8238 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:08.164498 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494e8ec9-af2e-48a6-b88e-f0dee62b8238 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:08.177131 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494e8ec9-af2e-48a6-b88e-f0dee62b8238 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 17:04:08.186936 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-494e8ec9-af2e-48a6-b88e-f0dee62b8238 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 17:04:08.186936 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:04:08.186936 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:04:08.186936 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:04:08.186936 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:04:08.186936 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:04:08.186936 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:04:08.186936 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:04:08.186936 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:04:08.186936 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:04:08.186936 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:04:08.186936 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:04:08.186936 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 17:04:08.186936 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 17:04:08.186936 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 17:04:08.186936 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 17:04:08.187852 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 17:04:08.187852 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 17:04:08.187852 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 17:04:08.187852 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 17:04:08.187852 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:04:08.187852 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:04:08.187852 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:04:08.187852 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:04:08.187852 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:04:08.187852 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:04:08.187852 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:04:08.187852 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Jul 14 17:04:08.187852 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:04:08.187852 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:04:08.187852 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:04:08.187852 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:04:08.188644 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:04:08.188644 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:04:08.188644 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:04:08.188644 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:04:08.188644 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 17:04:08.188644 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 17:04:08.188644 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 17:04:08.188644 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 17:04:08.188644 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 17:04:08.188644 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 17:04:08.188644 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 17:04:08.188644 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Jul 14 17:04:08.189759 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 133/254] 10.222.0.136 () {56 vars in 1101 bytes} [Thu Jul 14 17:04:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 397 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:04:08.198922 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494e8ec9-af2e-48a6-b88e-f0dee62b8238 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:08.303310 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d114c39-0f5d-406c-9efa-c4b46f47c3b2 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:08.373975 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89f2437-8352-4f18-a8a7-00501b92561a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:08.376558 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89f2437-8352-4f18-a8a7-00501b92561a None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:08.378366 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89f2437-8352-4f18-a8a7-00501b92561a None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:08.378850 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89f2437-8352-4f18-a8a7-00501b92561a None admin] PATH_INFO: `/v3/projects/dc58de68345f40498e25fd3ab4626f7f` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:08.381217 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89f2437-8352-4f18-a8a7-00501b92561a None admin] RBAC: Authorizing `identity:get_project(project_id=dc58de68345f40498e25fd3ab4626f7f)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:08.386043 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89f2437-8352-4f18-a8a7-00501b92561a None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:08.388027 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 122/255] 10.222.0.136 () {56 vars in 1191 bytes} [Thu Jul 14 17:04:08 2022] GET /identity/v3/projects/dc58de68345f40498e25fd3ab4626f7f => generated 303 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:04:08.391215 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6228997d-67a8-407a-9fbb-6520fb4ac972 None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:08.393030 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6228997d-67a8-407a-9fbb-6520fb4ac972 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:08.394466 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6228997d-67a8-407a-9fbb-6520fb4ac972 None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:08.396025 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 123/256] 10.222.0.136 () {54 vars in 931 bytes} [Thu Jul 14 17:04:08 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:04:08.399367 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6228997d-67a8-407a-9fbb-6520fb4ac972 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:08.415202 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494e8ec9-af2e-48a6-b88e-f0dee62b8238 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:08.482767 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0652368d-3d9f-4335-89e9-9ea16d99e4cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:08.484858 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0652368d-3d9f-4335-89e9-9ea16d99e4cc None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:08.485589 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0652368d-3d9f-4335-89e9-9ea16d99e4cc None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:08.486727 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0652368d-3d9f-4335-89e9-9ea16d99e4cc None admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:08.487860 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0652368d-3d9f-4335-89e9-9ea16d99e4cc None admin] RBAC: Adding query filter params (name=admin) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:04:08.489656 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0652368d-3d9f-4335-89e9-9ea16d99e4cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:08.491932 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0652368d-3d9f-4335-89e9-9ea16d99e4cc None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:08.509843 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 134/257] 10.222.0.136 () {56 vars in 1104 bytes} [Thu Jul 14 17:04:08 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:04:08.514332 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182d8a13-af2f-41b5-bd67-a9aa6910a128 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:08.514997 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182d8a13-af2f-41b5-bd67-a9aa6910a128 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:08.516381 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182d8a13-af2f-41b5-bd67-a9aa6910a128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:08.556291 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-182d8a13-af2f-41b5-bd67-a9aa6910a128 None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:04:08.559774 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-182d8a13-af2f-41b5-bd67-a9aa6910a128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:04:08.587004 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:08.615966 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6228997d-67a8-407a-9fbb-6520fb4ac972 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:08.636127 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:08.656546 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 135/258] 10.222.0.136 () {58 vars in 1028 bytes} [Thu Jul 14 17:04:08 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 17:04:08.658183 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182d8a13-af2f-41b5-bd67-a9aa6910a128 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:08.688407 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac76888-09b9-4161-a4b0-c5924086d15e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:08.691189 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac76888-09b9-4161-a4b0-c5924086d15e None admin] REQUEST_METHOD: `PUT` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:08.691189 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac76888-09b9-4161-a4b0-c5924086d15e None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:08.691189 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac76888-09b9-4161-a4b0-c5924086d15e None admin] PATH_INFO: `/v3/projects/dc58de68345f40498e25fd3ab4626f7f/users/f441e5f699c64526983207cb4181c564/roles/7441b1b1ab104537addd90a2471822f3` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:08.692850 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac76888-09b9-4161-a4b0-c5924086d15e None admin] RBAC: Authorizing `identity:create_grant(project_id=dc58de68345f40498e25fd3ab4626f7f, user_id=f441e5f699c64526983207cb4181c564, role_id=7441b1b1ab104537addd90a2471822f3)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:08.695952 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac76888-09b9-4161-a4b0-c5924086d15e None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:08.736095 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 124/259] 10.222.0.136 () {58 vars in 1444 bytes} [Thu Jul 14 17:04:08 2022] PUT /identity/v3/projects/dc58de68345f40498e25fd3ab4626f7f/users/f441e5f699c64526983207cb4181c564/roles/7441b1b1ab104537addd90a2471822f3 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:04:08.736901 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac76888-09b9-4161-a4b0-c5924086d15e None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:08.832819 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182d8a13-af2f-41b5-bd67-a9aa6910a128 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:08.904389 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a86042-a383-4fa6-9bda-68eedeb41000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:08.905709 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a86042-a383-4fa6-9bda-68eedeb41000 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:08.906901 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a86042-a383-4fa6-9bda-68eedeb41000 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:08.907502 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a86042-a383-4fa6-9bda-68eedeb41000 None admin] PATH_INFO: `/v3/users/962034238a674c5b87a85e8680ea60de` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:08.911692 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a86042-a383-4fa6-9bda-68eedeb41000 None admin] RBAC: Authorizing `identity:get_user(user_id=962034238a674c5b87a85e8680ea60de)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:08.914258 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a86042-a383-4fa6-9bda-68eedeb41000 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:08.916941 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 136/260] 10.222.0.136 () {56 vars in 1182 bytes} [Thu Jul 14 17:04:08 2022] GET /identity/v3/users/962034238a674c5b87a85e8680ea60de => generated 284 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:04:08.923212 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a86042-a383-4fa6-9bda-68eedeb41000 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:08.963675 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac76888-09b9-4161-a4b0-c5924086d15e None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:09.040614 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45312073-5c1e-4f63-a812-eec415073d48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:09.041632 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:09.042519 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45312073-5c1e-4f63-a812-eec415073d48 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:09.042951 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45312073-5c1e-4f63-a812-eec415073d48 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:09.043371 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45312073-5c1e-4f63-a812-eec415073d48 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:09.066677 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45312073-5c1e-4f63-a812-eec415073d48 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 17:04:09.079549 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-45312073-5c1e-4f63-a812-eec415073d48 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 17:04:09.079549 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:04:09.079549 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:04:09.079549 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:04:09.079549 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:04:09.079549 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:04:09.079549 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:04:09.079549 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:04:09.079549 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:04:09.079549 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:04:09.079549 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:04:09.079549 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:04:09.079549 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 17:04:09.079549 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 17:04:09.079549 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 17:04:09.079549 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 17:04:09.080644 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 17:04:09.080644 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 17:04:09.080644 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 17:04:09.080644 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 17:04:09.080644 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:04:09.080644 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:04:09.080644 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:04:09.080644 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:04:09.080644 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:04:09.080644 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:04:09.080644 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:04:09.080644 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Jul 14 17:04:09.080644 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:04:09.080644 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:04:09.080644 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:04:09.080644 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:04:09.081657 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:04:09.081657 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:04:09.081657 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:04:09.081657 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:04:09.081657 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 17:04:09.081657 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 17:04:09.081657 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 17:04:09.081657 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 17:04:09.081657 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 17:04:09.081657 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 17:04:09.081657 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 17:04:09.081657 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Jul 14 17:04:09.085717 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 125/261] 10.222.0.136 () {56 vars in 1119 bytes} [Thu Jul 14 17:04:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 349 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:04:09.095456 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45312073-5c1e-4f63-a812-eec415073d48 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:09.120452 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:09.145190 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a86042-a383-4fa6-9bda-68eedeb41000 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:09.217538 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e984e5f-0e1e-4576-9fd0-c9001c188098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:09.218450 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e984e5f-0e1e-4576-9fd0-c9001c188098 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:09.219216 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e984e5f-0e1e-4576-9fd0-c9001c188098 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:09.219783 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e984e5f-0e1e-4576-9fd0-c9001c188098 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:09.310686 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e984e5f-0e1e-4576-9fd0-c9001c188098 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:09.312287 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e984e5f-0e1e-4576-9fd0-c9001c188098 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:09.368913 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:09.382234 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45312073-5c1e-4f63-a812-eec415073d48 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:09.423419 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 137/262] 10.222.0.136 () {58 vars in 1287 bytes} [Thu Jul 14 17:04:08 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 501 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 14 17:04:09.428619 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e984e5f-0e1e-4576-9fd0-c9001c188098 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:09.465336 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c5885c-517b-4c73-86a7-b3b13536a7b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:09.469200 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c5885c-517b-4c73-86a7-b3b13536a7b3 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:09.469493 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c5885c-517b-4c73-86a7-b3b13536a7b3 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:09.469801 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c5885c-517b-4c73-86a7-b3b13536a7b3 None admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:09.470761 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c5885c-517b-4c73-86a7-b3b13536a7b3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:04:09.471078 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c5885c-517b-4c73-86a7-b3b13536a7b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:09.472473 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c5885c-517b-4c73-86a7-b3b13536a7b3 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:09.497340 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 126/263] 10.222.0.136 () {56 vars in 1116 bytes} [Thu Jul 14 17:04:09 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 402 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:04:09.519104 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c5885c-517b-4c73-86a7-b3b13536a7b3 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:09.613940 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e984e5f-0e1e-4576-9fd0-c9001c188098 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:09.655880 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b837c4ca-38ab-4606-8919-bb93f7c0fda7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:09.659154 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b837c4ca-38ab-4606-8919-bb93f7c0fda7 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:09.660433 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b837c4ca-38ab-4606-8919-bb93f7c0fda7 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:09.660926 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b837c4ca-38ab-4606-8919-bb93f7c0fda7 None admin] PATH_INFO: `/v3/projects/dc58de68345f40498e25fd3ab4626f7f` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:09.664076 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b837c4ca-38ab-4606-8919-bb93f7c0fda7 None admin] RBAC: Authorizing `identity:get_project(project_id=dc58de68345f40498e25fd3ab4626f7f)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:09.665845 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b837c4ca-38ab-4606-8919-bb93f7c0fda7 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:09.668460 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 138/264] 10.222.0.136 () {56 vars in 1191 bytes} [Thu Jul 14 17:04:09 2022] GET /identity/v3/projects/dc58de68345f40498e25fd3ab4626f7f => generated 303 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:04:09.675721 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b837c4ca-38ab-4606-8919-bb93f7c0fda7 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:09.680913 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:09.708087 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:09.756638 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c5885c-517b-4c73-86a7-b3b13536a7b3 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:09.801698 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b837c4ca-38ab-4606-8919-bb93f7c0fda7 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:09.841772 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81fd5a3-8833-4a69-bffb-585a834895bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:09.842534 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81fd5a3-8833-4a69-bffb-585a834895bb None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:09.842831 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81fd5a3-8833-4a69-bffb-585a834895bb None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:09.843111 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81fd5a3-8833-4a69-bffb-585a834895bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:09.844053 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81fd5a3-8833-4a69-bffb-585a834895bb None admin] RBAC: Adding query filter params (role.id=284c6314b4d3492085e397a87b0e3b51, scope.project.id=dc58de68345f40498e25fd3ab4626f7f, user.id=962034238a674c5b87a85e8680ea60de) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:04:09.844374 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81fd5a3-8833-4a69-bffb-585a834895bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:09.846065 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81fd5a3-8833-4a69-bffb-585a834895bb None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:09.846908 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755b72a0-a695-4789-9518-944150b07a90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:09.848046 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755b72a0-a695-4789-9518-944150b07a90 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:09.848535 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755b72a0-a695-4789-9518-944150b07a90 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:09.849008 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755b72a0-a695-4789-9518-944150b07a90 None admin] PATH_INFO: `/v3/users/962034238a674c5b87a85e8680ea60de` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:09.852142 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755b72a0-a695-4789-9518-944150b07a90 None admin] RBAC: Authorizing `identity:get_user(user_id=962034238a674c5b87a85e8680ea60de)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:09.853025 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 139/265] 10.222.0.136 () {56 vars in 1379 bytes} [Thu Jul 14 17:04:09 2022] GET /identity/v3/role_assignments?user.id=962034238a674c5b87a85e8680ea60de&scope.project.id=dc58de68345f40498e25fd3ab4626f7f&role.id=284c6314b4d3492085e397a87b0e3b51 => generated 610 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 17:04:09.854349 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755b72a0-a695-4789-9518-944150b07a90 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:09.856299 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 127/266] 10.222.0.136 () {56 vars in 1182 bytes} [Thu Jul 14 17:04:09 2022] GET /identity/v3/users/962034238a674c5b87a85e8680ea60de => generated 284 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:04:09.862965 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81fd5a3-8833-4a69-bffb-585a834895bb None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:09.997669 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:10.021815 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81fd5a3-8833-4a69-bffb-585a834895bb None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:10.069747 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e677f6-171d-45df-a542-2c50b52541c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:10.070424 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e677f6-171d-45df-a542-2c50b52541c9 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:10.070710 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e677f6-171d-45df-a542-2c50b52541c9 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:10.070989 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e677f6-171d-45df-a542-2c50b52541c9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:10.168192 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e677f6-171d-45df-a542-2c50b52541c9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:10.169979 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e677f6-171d-45df-a542-2c50b52541c9 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:10.273323 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:10.292740 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 140/267] 10.222.0.136 () {58 vars in 1287 bytes} [Thu Jul 14 17:04:09 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 17:04:10.298762 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755b72a0-a695-4789-9518-944150b07a90 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:10.310893 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036b4d34-e659-452b-8453-6151403750e5 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:10.311247 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036b4d34-e659-452b-8453-6151403750e5 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:10.311538 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036b4d34-e659-452b-8453-6151403750e5 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:10.312926 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 141/268] 10.222.0.136 () {54 vars in 931 bytes} [Thu Jul 14 17:04:10 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 14 17:04:10.326680 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df93b0ac-5056-4d2d-9916-40f1b4be6ba6 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:10.326984 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df93b0ac-5056-4d2d-9916-40f1b4be6ba6 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:10.327242 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df93b0ac-5056-4d2d-9916-40f1b4be6ba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:10.346784 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-df93b0ac-5056-4d2d-9916-40f1b4be6ba6 None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:04:10.347984 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-df93b0ac-5056-4d2d-9916-40f1b4be6ba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:04:10.426258 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 142/269] 10.222.0.136 () {58 vars in 1028 bytes} [Thu Jul 14 17:04:10 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 17:04:10.478026 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df93b0ac-5056-4d2d-9916-40f1b4be6ba6 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:10.502395 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755b72a0-a695-4789-9518-944150b07a90 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:10.583313 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861591eb-2c42-4fd2-9839-ae18905568ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:10.584179 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861591eb-2c42-4fd2-9839-ae18905568ca None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:10.584466 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861591eb-2c42-4fd2-9839-ae18905568ca None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:10.584752 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861591eb-2c42-4fd2-9839-ae18905568ca None admin] PATH_INFO: `/v3/projects/dc58de68345f40498e25fd3ab4626f7f` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:10.586239 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861591eb-2c42-4fd2-9839-ae18905568ca None admin] RBAC: Authorizing `identity:get_project(project_id=dc58de68345f40498e25fd3ab4626f7f)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:10.587698 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861591eb-2c42-4fd2-9839-ae18905568ca None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:10.593815 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 128/270] 10.222.0.136 () {56 vars in 1191 bytes} [Thu Jul 14 17:04:10 2022] GET /identity/v3/projects/dc58de68345f40498e25fd3ab4626f7f => generated 303 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:04:10.595572 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3231a14c-15df-451c-b498-968a60c75e73 None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:10.595572 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3231a14c-15df-451c-b498-968a60c75e73 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:10.595766 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3231a14c-15df-451c-b498-968a60c75e73 None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:10.596999 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 129/271] 10.222.0.136 () {54 vars in 931 bytes} [Thu Jul 14 17:04:10 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:04:10.603002 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7b1c4e-f1a4-4b1a-9414-70e95ece80f1 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:10.603295 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7b1c4e-f1a4-4b1a-9414-70e95ece80f1 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:10.603662 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7b1c4e-f1a4-4b1a-9414-70e95ece80f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:10.617811 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:10.624419 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-dc7b1c4e-f1a4-4b1a-9414-70e95ece80f1 None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:04:10.626090 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-dc7b1c4e-f1a4-4b1a-9414-70e95ece80f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:04:10.635492 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df93b0ac-5056-4d2d-9916-40f1b4be6ba6 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:10.665972 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:10.685693 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473896d5-81b5-49fc-8785-b14106a31e00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:10.686498 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473896d5-81b5-49fc-8785-b14106a31e00 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:10.686784 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473896d5-81b5-49fc-8785-b14106a31e00 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:10.687065 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473896d5-81b5-49fc-8785-b14106a31e00 None admin] PATH_INFO: `/v3/domains/default` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:10.688625 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473896d5-81b5-49fc-8785-b14106a31e00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:10.690634 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473896d5-81b5-49fc-8785-b14106a31e00 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:10.697665 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 143/272] 10.222.0.136 () {56 vars in 1113 bytes} [Thu Jul 14 17:04:10 2022] GET /identity/v3/domains/default => generated 200 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:04:10.697665 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473896d5-81b5-49fc-8785-b14106a31e00 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:10.729569 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 130/273] 10.222.0.136 () {58 vars in 1028 bytes} [Thu Jul 14 17:04:10 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 17:04:10.729569 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7b1c4e-f1a4-4b1a-9414-70e95ece80f1 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:10.837500 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7b1c4e-f1a4-4b1a-9414-70e95ece80f1 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:10.846506 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473896d5-81b5-49fc-8785-b14106a31e00 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:10.874636 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebef39eb-62ed-4114-b8cd-0a0671f5be76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:10.875321 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebef39eb-62ed-4114-b8cd-0a0671f5be76 None admin] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:10.875609 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebef39eb-62ed-4114-b8cd-0a0671f5be76 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:10.875890 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebef39eb-62ed-4114-b8cd-0a0671f5be76 None admin] PATH_INFO: `/v3/users` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:10.876593 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebef39eb-62ed-4114-b8cd-0a0671f5be76 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:10.878233 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebef39eb-62ed-4114-b8cd-0a0671f5be76 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:10.886948 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:10.889054 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7905d63-7e1e-42ff-a3c2-87900d5659e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:10.890116 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7905d63-7e1e-42ff-a3c2-87900d5659e0 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:10.890636 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7905d63-7e1e-42ff-a3c2-87900d5659e0 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:10.891195 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7905d63-7e1e-42ff-a3c2-87900d5659e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:10.893017 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7905d63-7e1e-42ff-a3c2-87900d5659e0 None admin] RBAC: Adding query filter params (role.id=5e321db416444dc9b5bfce7db763a7ed, scope.project.id=dc58de68345f40498e25fd3ab4626f7f, user.id=962034238a674c5b87a85e8680ea60de) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:04:10.893017 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7905d63-7e1e-42ff-a3c2-87900d5659e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:10.894506 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7905d63-7e1e-42ff-a3c2-87900d5659e0 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:10.909578 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 144/274] 10.222.0.136 () {56 vars in 1379 bytes} [Thu Jul 14 17:04:10 2022] GET /identity/v3/role_assignments?user.id=962034238a674c5b87a85e8680ea60de&scope.project.id=dc58de68345f40498e25fd3ab4626f7f&role.id=5e321db416444dc9b5bfce7db763a7ed => generated 610 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:04:10.909578 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7905d63-7e1e-42ff-a3c2-87900d5659e0 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:10.913950 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 131/275] 10.222.0.136 () {60 vars in 1137 bytes} [Thu Jul 14 17:04:10 2022] POST /identity/v3/users => generated 294 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 17:04:10.915489 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f66380-7221-45ba-aa90-6b6e4fa75bbb None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:10.915787 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f66380-7221-45ba-aa90-6b6e4fa75bbb None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:10.916072 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f66380-7221-45ba-aa90-6b6e4fa75bbb None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:10.917450 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 132/276] 10.222.0.136 () {54 vars in 931 bytes} [Thu Jul 14 17:04:10 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:04:10.931640 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35afb5b-c920-4818-b0eb-24e01aeaab89 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:10.931992 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35afb5b-c920-4818-b0eb-24e01aeaab89 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:10.932282 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35afb5b-c920-4818-b0eb-24e01aeaab89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:10.965504 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-d35afb5b-c920-4818-b0eb-24e01aeaab89 None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:04:10.966760 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-d35afb5b-c920-4818-b0eb-24e01aeaab89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:04:11.037692 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:11.130698 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 133/277] 10.222.0.136 () {58 vars in 1028 bytes} [Thu Jul 14 17:04:10 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 17:04:11.152179 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7905d63-7e1e-42ff-a3c2-87900d5659e0 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:11.155428 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35afb5b-c920-4818-b0eb-24e01aeaab89 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:11.205927 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4923758d-d8ec-446f-8ec1-760961b8941b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:11.209622 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4923758d-d8ec-446f-8ec1-760961b8941b None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:11.210680 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4923758d-d8ec-446f-8ec1-760961b8941b None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:11.216371 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4923758d-d8ec-446f-8ec1-760961b8941b None admin] PATH_INFO: `/v3/roles/member` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:11.228733 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4923758d-d8ec-446f-8ec1-760961b8941b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 17:04:11.241130 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-4923758d-d8ec-446f-8ec1-760961b8941b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 17:04:11.241130 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:04:11.241130 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:04:11.241130 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:04:11.241130 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:04:11.241130 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:04:11.241130 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:04:11.241130 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:04:11.241130 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:04:11.241130 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:04:11.241130 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:04:11.241130 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:04:11.241130 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 17:04:11.241130 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 17:04:11.241130 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 17:04:11.241130 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 17:04:11.242167 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 17:04:11.242167 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 17:04:11.242167 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 17:04:11.242167 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 17:04:11.242167 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:04:11.242167 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:04:11.242167 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:04:11.242167 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:04:11.242167 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:04:11.242167 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:04:11.242167 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:04:11.242167 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Jul 14 17:04:11.242167 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:04:11.242167 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:04:11.242167 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:04:11.242167 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:04:11.242982 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:04:11.242982 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:04:11.242982 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:04:11.242982 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:04:11.242982 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 17:04:11.242982 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 17:04:11.242982 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 17:04:11.242982 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 17:04:11.242982 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 17:04:11.242982 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 17:04:11.242982 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 17:04:11.242982 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Jul 14 17:04:11.242982 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 145/278] 10.222.0.136 () {56 vars in 1104 bytes} [Thu Jul 14 17:04:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:04:11.248658 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4923758d-d8ec-446f-8ec1-760961b8941b None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:11.307838 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35afb5b-c920-4818-b0eb-24e01aeaab89 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:11.337954 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:11.356818 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7520b3-1174-45c8-8902-5d647b7c26bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:11.357662 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7520b3-1174-45c8-8902-5d647b7c26bb None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:11.357950 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7520b3-1174-45c8-8902-5d647b7c26bb None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:11.358231 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7520b3-1174-45c8-8902-5d647b7c26bb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:11.371603 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7520b3-1174-45c8-8902-5d647b7c26bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 17:04:11.379716 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-6d7520b3-1174-45c8-8902-5d647b7c26bb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 17:04:11.379716 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:04:11.379716 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:04:11.379716 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:04:11.379716 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:04:11.379716 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:04:11.379716 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:04:11.379716 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:04:11.379716 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:04:11.379716 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:04:11.379716 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:04:11.379716 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:04:11.379716 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 17:04:11.379716 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 17:04:11.379716 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 17:04:11.379716 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 17:04:11.380981 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 17:04:11.380981 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 17:04:11.380981 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 17:04:11.380981 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 17:04:11.380981 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:04:11.380981 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:04:11.380981 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:04:11.380981 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:04:11.380981 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:04:11.380981 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:04:11.380981 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:04:11.380981 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Jul 14 17:04:11.380981 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:04:11.380981 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:04:11.380981 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:04:11.380981 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:04:11.382108 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:04:11.382108 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:04:11.382108 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:04:11.382108 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:04:11.382108 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 17:04:11.382108 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 17:04:11.382108 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 17:04:11.382108 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 17:04:11.382108 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 17:04:11.382108 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 17:04:11.382108 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 17:04:11.382108 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Jul 14 17:04:11.382108 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 134/279] 10.222.0.136 () {56 vars in 1104 bytes} [Thu Jul 14 17:04:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 17:04:11.388968 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7520b3-1174-45c8-8902-5d647b7c26bb None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:11.390691 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4923758d-d8ec-446f-8ec1-760961b8941b None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:11.399757 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:11.434765 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22147b4-539e-44ad-935f-1149e1def889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:11.435438 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22147b4-539e-44ad-935f-1149e1def889 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:11.435726 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22147b4-539e-44ad-935f-1149e1def889 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:11.436006 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22147b4-539e-44ad-935f-1149e1def889 None admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:11.436759 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22147b4-539e-44ad-935f-1149e1def889 None admin] RBAC: Adding query filter params (name=member) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:04:11.437900 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22147b4-539e-44ad-935f-1149e1def889 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:11.438504 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22147b4-539e-44ad-935f-1149e1def889 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:11.457695 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 146/280] 10.222.0.136 () {56 vars in 1106 bytes} [Thu Jul 14 17:04:11 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:04:11.460391 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22147b4-539e-44ad-935f-1149e1def889 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:11.515888 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7520b3-1174-45c8-8902-5d647b7c26bb None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:11.561144 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb1b49b-04c0-4668-a930-424ef9289904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:11.561863 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb1b49b-04c0-4668-a930-424ef9289904 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:11.562282 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb1b49b-04c0-4668-a930-424ef9289904 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:11.562695 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb1b49b-04c0-4668-a930-424ef9289904 None admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:11.563477 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb1b49b-04c0-4668-a930-424ef9289904 None admin] RBAC: Adding query filter params (name=reader) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:04:11.563793 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb1b49b-04c0-4668-a930-424ef9289904 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:11.565686 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb1b49b-04c0-4668-a930-424ef9289904 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:11.583142 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 135/281] 10.222.0.136 () {56 vars in 1106 bytes} [Thu Jul 14 17:04:11 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:04:11.588735 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb1b49b-04c0-4668-a930-424ef9289904 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:11.604092 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22147b4-539e-44ad-935f-1149e1def889 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:11.679148 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac31877-0231-4b7c-9803-1d22b97980a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:11.680911 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac31877-0231-4b7c-9803-1d22b97980a2 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:11.683593 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac31877-0231-4b7c-9803-1d22b97980a2 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:11.684156 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac31877-0231-4b7c-9803-1d22b97980a2 None admin] PATH_INFO: `/v3/users/03cba826dbe24b0ca8b124742bfb5d97` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:11.698097 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:11.712156 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac31877-0231-4b7c-9803-1d22b97980a2 None admin] RBAC: Authorizing `identity:get_user(user_id=03cba826dbe24b0ca8b124742bfb5d97)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:11.722258 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac31877-0231-4b7c-9803-1d22b97980a2 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:11.724590 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 147/282] 10.222.0.136 () {56 vars in 1182 bytes} [Thu Jul 14 17:04:11 2022] GET /identity/v3/users/03cba826dbe24b0ca8b124742bfb5d97 => generated 294 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:04:11.747151 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac31877-0231-4b7c-9803-1d22b97980a2 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:11.783062 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb1b49b-04c0-4668-a930-424ef9289904 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:11.815313 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:11.825811 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039c3796-6a98-44ac-af6f-d48374ec5cad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:11.826743 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039c3796-6a98-44ac-af6f-d48374ec5cad None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:11.827037 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039c3796-6a98-44ac-af6f-d48374ec5cad None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:11.827328 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039c3796-6a98-44ac-af6f-d48374ec5cad None admin] PATH_INFO: `/v3/users/108d6d251cf74b26ad46d7d78d319f1c` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:11.828940 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039c3796-6a98-44ac-af6f-d48374ec5cad None admin] RBAC: Authorizing `identity:get_user(user_id=108d6d251cf74b26ad46d7d78d319f1c)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:11.830604 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039c3796-6a98-44ac-af6f-d48374ec5cad None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:11.832856 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 136/283] 10.222.0.136 () {56 vars in 1182 bytes} [Thu Jul 14 17:04:11 2022] GET /identity/v3/users/108d6d251cf74b26ad46d7d78d319f1c => generated 298 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:04:11.843449 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039c3796-6a98-44ac-af6f-d48374ec5cad None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:11.925222 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac31877-0231-4b7c-9803-1d22b97980a2 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:11.964963 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a1011e-607d-46a8-b739-8ed22c817e3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:11.965556 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a1011e-607d-46a8-b739-8ed22c817e3c None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:11.965862 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a1011e-607d-46a8-b739-8ed22c817e3c None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:11.966137 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a1011e-607d-46a8-b739-8ed22c817e3c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:11.966967 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a1011e-607d-46a8-b739-8ed22c817e3c None admin] RBAC: Adding query filter params (role.id=7441b1b1ab104537addd90a2471822f3, user.id=03cba826dbe24b0ca8b124742bfb5d97, scope.system=all) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:04:11.967277 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a1011e-607d-46a8-b739-8ed22c817e3c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:11.968706 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a1011e-607d-46a8-b739-8ed22c817e3c None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:11.975529 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 148/284] 10.222.0.136 () {56 vars in 1313 bytes} [Thu Jul 14 17:04:11 2022] GET /identity/v3/role_assignments?user.id=03cba826dbe24b0ca8b124742bfb5d97&scope.system=all&role.id=7441b1b1ab104537addd90a2471822f3 => generated 227 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:04:11.976680 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c551aa-2db2-474a-9330-08d951655434 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:11.976973 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c551aa-2db2-474a-9330-08d951655434 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:11.977253 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c551aa-2db2-474a-9330-08d951655434 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:11.978904 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 149/285] 10.222.0.136 () {54 vars in 931 bytes} [Thu Jul 14 17:04:11 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:04:11.984920 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1fb90f-8a16-458d-80bf-e456ae30b589 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:11.985253 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1fb90f-8a16-458d-80bf-e456ae30b589 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:11.985487 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1fb90f-8a16-458d-80bf-e456ae30b589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:11.992287 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039c3796-6a98-44ac-af6f-d48374ec5cad None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:12.013918 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-1e1fb90f-8a16-458d-80bf-e456ae30b589 None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:04:12.015144 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-1e1fb90f-8a16-458d-80bf-e456ae30b589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:04:12.022959 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:12.069914 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0086344b-791e-453c-a17f-59aa36c17019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:12.070802 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0086344b-791e-453c-a17f-59aa36c17019 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:12.071084 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0086344b-791e-453c-a17f-59aa36c17019 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:12.071359 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0086344b-791e-453c-a17f-59aa36c17019 None admin] PATH_INFO: `/v3/projects/dc58de68345f40498e25fd3ab4626f7f` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:12.074277 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0086344b-791e-453c-a17f-59aa36c17019 None admin] RBAC: Authorizing `identity:get_project(project_id=dc58de68345f40498e25fd3ab4626f7f)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:12.075787 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0086344b-791e-453c-a17f-59aa36c17019 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:12.077640 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 137/286] 10.222.0.136 () {56 vars in 1191 bytes} [Thu Jul 14 17:04:11 2022] GET /identity/v3/projects/dc58de68345f40498e25fd3ab4626f7f => generated 303 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:04:12.088427 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0086344b-791e-453c-a17f-59aa36c17019 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:12.182056 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 150/287] 10.222.0.136 () {58 vars in 1028 bytes} [Thu Jul 14 17:04:11 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 17:04:12.220679 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1fb90f-8a16-458d-80bf-e456ae30b589 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:12.247369 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:12.257593 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0086344b-791e-453c-a17f-59aa36c17019 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:12.301410 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff355ee-84cd-4de5-a294-7a0e67efdfd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:12.304164 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff355ee-84cd-4de5-a294-7a0e67efdfd2 None admin] REQUEST_METHOD: `PUT` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:12.305883 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff355ee-84cd-4de5-a294-7a0e67efdfd2 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:12.306309 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff355ee-84cd-4de5-a294-7a0e67efdfd2 None admin] PATH_INFO: `/v3/projects/dc58de68345f40498e25fd3ab4626f7f/users/108d6d251cf74b26ad46d7d78d319f1c/roles/2df0ddb31c5141c496d5705ff0dd2bc0` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:12.311278 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff355ee-84cd-4de5-a294-7a0e67efdfd2 None admin] RBAC: Authorizing `identity:create_grant(project_id=dc58de68345f40498e25fd3ab4626f7f, user_id=108d6d251cf74b26ad46d7d78d319f1c, role_id=2df0ddb31c5141c496d5705ff0dd2bc0)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:12.316539 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff355ee-84cd-4de5-a294-7a0e67efdfd2 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:12.346496 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 138/288] 10.222.0.136 () {58 vars in 1444 bytes} [Thu Jul 14 17:04:12 2022] PUT /identity/v3/projects/dc58de68345f40498e25fd3ab4626f7f/users/108d6d251cf74b26ad46d7d78d319f1c/roles/2df0ddb31c5141c496d5705ff0dd2bc0 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:04:12.385305 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1fb90f-8a16-458d-80bf-e456ae30b589 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:12.437489 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2ce5c9-21d4-4a09-bc4c-c9ba16e9f187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:12.438600 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2ce5c9-21d4-4a09-bc4c-c9ba16e9f187 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:12.439120 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2ce5c9-21d4-4a09-bc4c-c9ba16e9f187 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:12.439568 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2ce5c9-21d4-4a09-bc4c-c9ba16e9f187 None admin] PATH_INFO: `/v3/roles/member` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:12.451936 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2ce5c9-21d4-4a09-bc4c-c9ba16e9f187 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 17:04:12.465214 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-fc2ce5c9-21d4-4a09-bc4c-c9ba16e9f187 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 17:04:12.465214 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:04:12.465214 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:04:12.465214 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:04:12.465214 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:04:12.465214 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:04:12.465214 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:04:12.465214 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:04:12.465214 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:04:12.465214 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:04:12.465214 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:04:12.465214 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:04:12.465214 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 17:04:12.465214 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 17:04:12.465214 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 17:04:12.465214 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 17:04:12.466372 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 17:04:12.466372 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 17:04:12.466372 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 17:04:12.466372 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 17:04:12.466372 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:04:12.466372 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:04:12.466372 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:04:12.466372 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:04:12.466372 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:04:12.466372 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:04:12.466372 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:04:12.466372 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Jul 14 17:04:12.466372 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:04:12.466372 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:04:12.466372 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:04:12.466372 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:04:12.467343 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:04:12.467343 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:04:12.467343 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:04:12.467343 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:04:12.467343 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 17:04:12.467343 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 17:04:12.467343 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 17:04:12.467343 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 17:04:12.467343 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 17:04:12.467343 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 17:04:12.467343 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 17:04:12.467343 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Jul 14 17:04:12.469765 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 151/289] 10.222.0.136 () {56 vars in 1104 bytes} [Thu Jul 14 17:04:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 17:04:12.476812 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff355ee-84cd-4de5-a294-7a0e67efdfd2 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:12.563284 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:12.645779 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff355ee-84cd-4de5-a294-7a0e67efdfd2 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:12.688838 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c6937f-0705-4d7b-9b7f-5e1dc1263dce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:12.689571 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c6937f-0705-4d7b-9b7f-5e1dc1263dce None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:12.689886 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c6937f-0705-4d7b-9b7f-5e1dc1263dce None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:12.690173 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c6937f-0705-4d7b-9b7f-5e1dc1263dce None admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:12.690955 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c6937f-0705-4d7b-9b7f-5e1dc1263dce None admin] RBAC: Adding query filter params (name=member) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:04:12.691269 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c6937f-0705-4d7b-9b7f-5e1dc1263dce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:12.692706 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c6937f-0705-4d7b-9b7f-5e1dc1263dce None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:12.703730 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 139/290] 10.222.0.136 () {56 vars in 1106 bytes} [Thu Jul 14 17:04:12 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 17:04:12.710153 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2ce5c9-21d4-4a09-bc4c-c9ba16e9f187 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:12.806804 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:12.829733 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2ce5c9-21d4-4a09-bc4c-c9ba16e9f187 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:12.883721 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715ccb11-4e36-4f06-89d2-0a08aee9e807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:12.884600 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715ccb11-4e36-4f06-89d2-0a08aee9e807 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:12.884888 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715ccb11-4e36-4f06-89d2-0a08aee9e807 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:12.885166 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715ccb11-4e36-4f06-89d2-0a08aee9e807 None admin] PATH_INFO: `/v3/users/f441e5f699c64526983207cb4181c564` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:12.886411 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715ccb11-4e36-4f06-89d2-0a08aee9e807 None admin] RBAC: Authorizing `identity:get_user(user_id=f441e5f699c64526983207cb4181c564)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:12.887866 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715ccb11-4e36-4f06-89d2-0a08aee9e807 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:12.889495 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 152/291] 10.222.0.136 () {56 vars in 1182 bytes} [Thu Jul 14 17:04:12 2022] GET /identity/v3/users/f441e5f699c64526983207cb4181c564 => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:04:12.894990 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c6937f-0705-4d7b-9b7f-5e1dc1263dce None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:13.027132 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c6937f-0705-4d7b-9b7f-5e1dc1263dce None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:13.028607 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:13.071095 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c42b29-61ce-4be4-b13a-901207a47c54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:13.071673 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c42b29-61ce-4be4-b13a-901207a47c54 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:13.071961 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c42b29-61ce-4be4-b13a-901207a47c54 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:13.072242 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c42b29-61ce-4be4-b13a-901207a47c54 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:13.159371 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c42b29-61ce-4be4-b13a-901207a47c54 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:13.160932 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c42b29-61ce-4be4-b13a-901207a47c54 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:13.270946 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 140/292] 10.222.0.136 () {58 vars in 1287 bytes} [Thu Jul 14 17:04:12 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 17:04:13.277517 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715ccb11-4e36-4f06-89d2-0a08aee9e807 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:13.408451 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715ccb11-4e36-4f06-89d2-0a08aee9e807 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:13.443923 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8508f8ec-1ca7-420a-b416-5f28248f4f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:13.444796 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8508f8ec-1ca7-420a-b416-5f28248f4f04 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:13.445088 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8508f8ec-1ca7-420a-b416-5f28248f4f04 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:13.445363 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8508f8ec-1ca7-420a-b416-5f28248f4f04 None admin] PATH_INFO: `/v3/projects/dc58de68345f40498e25fd3ab4626f7f` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:13.446653 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8508f8ec-1ca7-420a-b416-5f28248f4f04 None admin] RBAC: Authorizing `identity:get_project(project_id=dc58de68345f40498e25fd3ab4626f7f)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:13.448090 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8508f8ec-1ca7-420a-b416-5f28248f4f04 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:13.450158 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 153/293] 10.222.0.136 () {56 vars in 1191 bytes} [Thu Jul 14 17:04:13 2022] GET /identity/v3/projects/dc58de68345f40498e25fd3ab4626f7f => generated 303 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:04:13.456040 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c42b29-61ce-4be4-b13a-901207a47c54 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:13.458250 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:13.562744 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c42b29-61ce-4be4-b13a-901207a47c54 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:13.600814 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ecfbdf-ec47-423b-8129-8f330431e951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:13.601574 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ecfbdf-ec47-423b-8129-8f330431e951 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:13.601878 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ecfbdf-ec47-423b-8129-8f330431e951 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:13.602160 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ecfbdf-ec47-423b-8129-8f330431e951 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:13.602989 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ecfbdf-ec47-423b-8129-8f330431e951 None admin] RBAC: Adding query filter params (role.id=7441b1b1ab104537addd90a2471822f3, scope.project.id=dc58de68345f40498e25fd3ab4626f7f, user.id=f441e5f699c64526983207cb4181c564) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:04:13.603307 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ecfbdf-ec47-423b-8129-8f330431e951 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:13.604756 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ecfbdf-ec47-423b-8129-8f330431e951 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:13.611484 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 141/294] 10.222.0.136 () {56 vars in 1379 bytes} [Thu Jul 14 17:04:13 2022] GET /identity/v3/role_assignments?user.id=f441e5f699c64526983207cb4181c564&scope.project.id=dc58de68345f40498e25fd3ab4626f7f&role.id=7441b1b1ab104537addd90a2471822f3 => generated 610 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:04:14.103343 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cbce94-342d-47cc-993d-214c0b18aa71 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:14.103853 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cbce94-342d-47cc-993d-214c0b18aa71 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:14.103926 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cbce94-342d-47cc-993d-214c0b18aa71 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:14.105538 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 154/295] 10.222.0.136 () {54 vars in 931 bytes} [Thu Jul 14 17:04:14 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:04:14.110850 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd2e7fd-32b6-485d-9cc4-18c8159dcf7e None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:14.111149 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd2e7fd-32b6-485d-9cc4-18c8159dcf7e None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:14.111434 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd2e7fd-32b6-485d-9cc4-18c8159dcf7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:14.131702 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-3fd2e7fd-32b6-485d-9cc4-18c8159dcf7e None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:04:14.133010 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-3fd2e7fd-32b6-485d-9cc4-18c8159dcf7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:04:14.214596 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:14.218203 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 142/296] 10.222.0.136 () {58 vars in 1028 bytes} [Thu Jul 14 17:04:14 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 17:04:14.231048 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df674dd2-a304-46b0-b1e5-f93afd13daf5 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:14.231601 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df674dd2-a304-46b0-b1e5-f93afd13daf5 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:14.231881 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df674dd2-a304-46b0-b1e5-f93afd13daf5 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:14.233406 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 155/297] 10.222.0.136 () {54 vars in 931 bytes} [Thu Jul 14 17:04:14 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:04:14.238877 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7306a013-4e68-46c3-8e51-0539d3e2b6b5 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:14.239375 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7306a013-4e68-46c3-8e51-0539d3e2b6b5 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:14.240390 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7306a013-4e68-46c3-8e51-0539d3e2b6b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:14.245277 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df674dd2-a304-46b0-b1e5-f93afd13daf5 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:14.259889 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-7306a013-4e68-46c3-8e51-0539d3e2b6b5 None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:04:14.261127 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-7306a013-4e68-46c3-8e51-0539d3e2b6b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:04:14.273830 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:14.361738 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 143/298] 10.222.0.136 () {58 vars in 1028 bytes} [Thu Jul 14 17:04:14 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 17:04:14.384271 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df674dd2-a304-46b0-b1e5-f93afd13daf5 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:14.394921 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7306a013-4e68-46c3-8e51-0539d3e2b6b5 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:14.435238 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39227e5f-82a9-4f0a-a77d-ea68774c7314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:14.436297 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39227e5f-82a9-4f0a-a77d-ea68774c7314 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:14.437634 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39227e5f-82a9-4f0a-a77d-ea68774c7314 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:14.438059 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39227e5f-82a9-4f0a-a77d-ea68774c7314 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:14.451990 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39227e5f-82a9-4f0a-a77d-ea68774c7314 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 17:04:14.462591 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-39227e5f-82a9-4f0a-a77d-ea68774c7314 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 17:04:14.462591 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:04:14.462591 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:04:14.462591 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:04:14.462591 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:04:14.462591 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:04:14.462591 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:04:14.462591 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:04:14.462591 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:04:14.462591 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:04:14.462591 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:04:14.462591 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:04:14.462591 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 17:04:14.462591 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 17:04:14.462591 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 17:04:14.462591 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 17:04:14.463703 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 17:04:14.463703 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 17:04:14.463703 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 17:04:14.463703 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 17:04:14.463703 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:04:14.463703 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:04:14.463703 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:04:14.463703 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:04:14.463703 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:04:14.463703 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:04:14.463703 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:04:14.463703 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Jul 14 17:04:14.463703 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:04:14.463703 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:04:14.463703 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:04:14.463703 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:04:14.464665 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:04:14.464665 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:04:14.464665 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:04:14.464665 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:04:14.464665 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 17:04:14.464665 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 17:04:14.464665 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 17:04:14.464665 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 17:04:14.464665 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 17:04:14.464665 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 17:04:14.464665 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 17:04:14.464665 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Jul 14 17:04:14.467300 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 156/299] 10.222.0.136 () {56 vars in 1104 bytes} [Thu Jul 14 17:04:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 17:04:14.476012 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39227e5f-82a9-4f0a-a77d-ea68774c7314 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:14.523189 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7306a013-4e68-46c3-8e51-0539d3e2b6b5 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:14.550413 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:14.560555 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92261e3-9833-44b8-beed-1f85385ea07c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:14.561509 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92261e3-9833-44b8-beed-1f85385ea07c None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:14.561918 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92261e3-9833-44b8-beed-1f85385ea07c None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:14.562290 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92261e3-9833-44b8-beed-1f85385ea07c None admin] PATH_INFO: `/v3/domains/default` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:14.563824 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92261e3-9833-44b8-beed-1f85385ea07c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:14.565192 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:14.565479 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92261e3-9833-44b8-beed-1f85385ea07c None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:14.567347 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 144/300] 10.222.0.136 () {56 vars in 1113 bytes} [Thu Jul 14 17:04:14 2022] GET /identity/v3/domains/default => generated 200 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 17:04:14.573656 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92261e3-9833-44b8-beed-1f85385ea07c None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:14.599923 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39227e5f-82a9-4f0a-a77d-ea68774c7314 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:14.638961 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4203a6-d8ac-4e9b-b6c7-d1e7453fcffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:14.640198 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4203a6-d8ac-4e9b-b6c7-d1e7453fcffb None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:14.640626 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4203a6-d8ac-4e9b-b6c7-d1e7453fcffb None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:14.641040 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4203a6-d8ac-4e9b-b6c7-d1e7453fcffb None admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:14.642419 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4203a6-d8ac-4e9b-b6c7-d1e7453fcffb None admin] RBAC: Adding query filter params (name=reader) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:04:14.643009 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4203a6-d8ac-4e9b-b6c7-d1e7453fcffb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:14.644995 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4203a6-d8ac-4e9b-b6c7-d1e7453fcffb None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:14.654684 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 157/301] 10.222.0.136 () {56 vars in 1106 bytes} [Thu Jul 14 17:04:14 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 17:04:14.656042 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cc03c1-922d-46eb-b55d-466b0cfc31ca None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:14.656333 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cc03c1-922d-46eb-b55d-466b0cfc31ca None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:14.656610 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cc03c1-922d-46eb-b55d-466b0cfc31ca None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:14.657972 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 158/302] 10.222.0.136 () {54 vars in 931 bytes} [Thu Jul 14 17:04:14 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:04:14.660087 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cc03c1-922d-46eb-b55d-466b0cfc31ca None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:14.689875 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92261e3-9833-44b8-beed-1f85385ea07c None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:14.727719 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fc3b6b-0d45-449f-aabc-8195202ad6bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:14.728758 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fc3b6b-0d45-449f-aabc-8195202ad6bc None admin] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:14.729290 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fc3b6b-0d45-449f-aabc-8195202ad6bc None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:14.729672 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fc3b6b-0d45-449f-aabc-8195202ad6bc None admin] PATH_INFO: `/v3/groups` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:14.730361 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fc3b6b-0d45-449f-aabc-8195202ad6bc None admin] RBAC: Authorizing `identity:create_group()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:14.732067 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fc3b6b-0d45-449f-aabc-8195202ad6bc None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:14.756226 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 145/303] 10.222.0.136 () {60 vars in 1139 bytes} [Thu Jul 14 17:04:14 2022] POST /identity/v3/groups => generated 230 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 17:04:14.756226 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7af8390-665d-4f2d-8695-91b3bb80ea34 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:14.756226 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7af8390-665d-4f2d-8695-91b3bb80ea34 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:14.756226 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7af8390-665d-4f2d-8695-91b3bb80ea34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:14.775004 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-e7af8390-665d-4f2d-8695-91b3bb80ea34 None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:04:14.776323 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-e7af8390-665d-4f2d-8695-91b3bb80ea34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:04:14.779558 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cc03c1-922d-46eb-b55d-466b0cfc31ca None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:14.830243 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb29206-2e49-4bc8-ad2c-9e27765747e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:14.831442 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb29206-2e49-4bc8-ad2c-9e27765747e0 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:14.831800 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb29206-2e49-4bc8-ad2c-9e27765747e0 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:14.832571 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb29206-2e49-4bc8-ad2c-9e27765747e0 None admin] PATH_INFO: `/v3/users/f9c8aae316ae458c8fcecc741a32ca77` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:14.844176 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:14.848924 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:14.855098 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb29206-2e49-4bc8-ad2c-9e27765747e0 None admin] RBAC: Authorizing `identity:get_user(user_id=f9c8aae316ae458c8fcecc741a32ca77)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:14.856974 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb29206-2e49-4bc8-ad2c-9e27765747e0 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:14.857669 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 146/304] 10.222.0.136 () {58 vars in 1028 bytes} [Thu Jul 14 17:04:14 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 17:04:14.864544 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 159/305] 10.222.0.136 () {56 vars in 1182 bytes} [Thu Jul 14 17:04:14 2022] GET /identity/v3/users/f9c8aae316ae458c8fcecc741a32ca77 => generated 294 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:04:14.870708 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7af8390-665d-4f2d-8695-91b3bb80ea34 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:14.884054 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb29206-2e49-4bc8-ad2c-9e27765747e0 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:15.011091 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7af8390-665d-4f2d-8695-91b3bb80ea34 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:15.021464 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb29206-2e49-4bc8-ad2c-9e27765747e0 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:15.050625 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caf9d81-e287-4201-acbe-2f747411ad6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:15.051289 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caf9d81-e287-4201-acbe-2f747411ad6e None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:15.051570 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caf9d81-e287-4201-acbe-2f747411ad6e None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:15.051842 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caf9d81-e287-4201-acbe-2f747411ad6e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:15.053220 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5caf9d81-e287-4201-acbe-2f747411ad6e None admin] RBAC: Adding query filter params (role.id=2df0ddb31c5141c496d5705ff0dd2bc0, user.id=f9c8aae316ae458c8fcecc741a32ca77, scope.system=all) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:04:15.053529 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5caf9d81-e287-4201-acbe-2f747411ad6e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:15.055078 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5caf9d81-e287-4201-acbe-2f747411ad6e None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:15.058418 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a159667-f74e-420a-9044-c16dad5bed2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:15.059217 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a159667-f74e-420a-9044-c16dad5bed2c None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:15.059506 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a159667-f74e-420a-9044-c16dad5bed2c None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:15.059784 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a159667-f74e-420a-9044-c16dad5bed2c None admin] PATH_INFO: `/v3/roles/member` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:15.060966 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 147/306] 10.222.0.136 () {56 vars in 1313 bytes} [Thu Jul 14 17:04:14 2022] GET /identity/v3/role_assignments?user.id=f9c8aae316ae458c8fcecc741a32ca77&scope.system=all&role.id=2df0ddb31c5141c496d5705ff0dd2bc0 => generated 227 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:04:15.076869 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a159667-f74e-420a-9044-c16dad5bed2c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 17:04:15.085271 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-7a159667-f74e-420a-9044-c16dad5bed2c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 17:04:15.085271 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:04:15.085271 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:04:15.085271 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:04:15.085271 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:04:15.085271 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:04:15.085271 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:04:15.085271 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:04:15.085271 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:04:15.085271 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:04:15.085271 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:04:15.085271 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:04:15.085271 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 17:04:15.085271 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 17:04:15.085271 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 17:04:15.085271 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 17:04:15.086271 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 17:04:15.086271 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 17:04:15.086271 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 17:04:15.086271 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 17:04:15.086271 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:04:15.086271 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:04:15.086271 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:04:15.086271 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:04:15.086271 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:04:15.086271 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:04:15.086271 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:04:15.086271 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Jul 14 17:04:15.086271 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:04:15.086271 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:04:15.086271 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:04:15.086271 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:04:15.087073 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:04:15.087073 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:04:15.087073 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:04:15.087073 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:04:15.087073 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 17:04:15.087073 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 17:04:15.087073 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 17:04:15.087073 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 17:04:15.087073 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 17:04:15.087073 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 17:04:15.087073 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 17:04:15.087073 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Jul 14 17:04:15.087073 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 160/307] 10.222.0.136 () {56 vars in 1104 bytes} [Thu Jul 14 17:04:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 17:04:15.093155 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caf9d81-e287-4201-acbe-2f747411ad6e None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:15.152155 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:15.228639 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caf9d81-e287-4201-acbe-2f747411ad6e None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:15.267762 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc2fa91-e362-4adf-be82-44bb95df7206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:15.268359 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc2fa91-e362-4adf-be82-44bb95df7206 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:15.268705 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc2fa91-e362-4adf-be82-44bb95df7206 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:15.268985 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc2fa91-e362-4adf-be82-44bb95df7206 None admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:15.269873 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc2fa91-e362-4adf-be82-44bb95df7206 None admin] RBAC: Adding query filter params (name=member) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:04:15.270179 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc2fa91-e362-4adf-be82-44bb95df7206 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:15.271706 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc2fa91-e362-4adf-be82-44bb95df7206 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:15.280748 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 148/308] 10.222.0.136 () {56 vars in 1106 bytes} [Thu Jul 14 17:04:15 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:04:15.286210 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a159667-f74e-420a-9044-c16dad5bed2c None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:15.353318 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:15.370866 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18197b3c-6045-4db3-bfd8-23dc15c4c163 None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:15.371209 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18197b3c-6045-4db3-bfd8-23dc15c4c163 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:15.371445 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18197b3c-6045-4db3-bfd8-23dc15c4c163 None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:15.372854 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 149/309] 10.222.0.136 () {54 vars in 931 bytes} [Thu Jul 14 17:04:15 2022] GET /identity => generated 271 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:04:15.378329 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8b43c7-f804-42ec-b14c-7ddc7e18467b None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:15.378647 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8b43c7-f804-42ec-b14c-7ddc7e18467b None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:15.378912 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8b43c7-f804-42ec-b14c-7ddc7e18467b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:15.399196 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-df8b43c7-f804-42ec-b14c-7ddc7e18467b None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:04:15.400386 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-df8b43c7-f804-42ec-b14c-7ddc7e18467b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:04:15.414019 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a159667-f74e-420a-9044-c16dad5bed2c None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:15.450782 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faedd6c-e0fc-4096-8387-8394e9015f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:15.451998 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faedd6c-e0fc-4096-8387-8394e9015f17 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:15.452467 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faedd6c-e0fc-4096-8387-8394e9015f17 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:15.452926 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faedd6c-e0fc-4096-8387-8394e9015f17 None admin] PATH_INFO: `/v3/users/03cba826dbe24b0ca8b124742bfb5d97` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:15.454336 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1faedd6c-e0fc-4096-8387-8394e9015f17 None admin] RBAC: Authorizing `identity:get_user(user_id=03cba826dbe24b0ca8b124742bfb5d97)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:15.455966 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1faedd6c-e0fc-4096-8387-8394e9015f17 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:15.458130 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 161/310] 10.222.0.136 () {56 vars in 1182 bytes} [Thu Jul 14 17:04:15 2022] GET /identity/v3/users/03cba826dbe24b0ca8b124742bfb5d97 => generated 294 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 17:04:15.463960 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faedd6c-e0fc-4096-8387-8394e9015f17 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:15.485993 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 150/311] 10.222.0.136 () {58 vars in 1028 bytes} [Thu Jul 14 17:04:15 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 17:04:15.511515 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8b43c7-f804-42ec-b14c-7ddc7e18467b None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:15.568516 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:15.581989 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faedd6c-e0fc-4096-8387-8394e9015f17 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:15.608393 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:15.622662 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf0c719-aa61-4b80-bbca-3307c7f6aba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:15.624052 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf0c719-aa61-4b80-bbca-3307c7f6aba5 None admin] REQUEST_METHOD: `PUT` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:15.624492 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf0c719-aa61-4b80-bbca-3307c7f6aba5 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:15.625119 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf0c719-aa61-4b80-bbca-3307c7f6aba5 None admin] PATH_INFO: `/v3/system/users/03cba826dbe24b0ca8b124742bfb5d97/roles/7441b1b1ab104537addd90a2471822f3` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:15.627504 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf0c719-aa61-4b80-bbca-3307c7f6aba5 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=03cba826dbe24b0ca8b124742bfb5d97, role_id=7441b1b1ab104537addd90a2471822f3)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:15.629181 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf0c719-aa61-4b80-bbca-3307c7f6aba5 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:15.641318 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 162/312] 10.222.0.136 () {58 vars in 1339 bytes} [Thu Jul 14 17:04:15 2022] PUT /identity/v3/system/users/03cba826dbe24b0ca8b124742bfb5d97/roles/7441b1b1ab104537addd90a2471822f3 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 17:04:15.652225 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8b43c7-f804-42ec-b14c-7ddc7e18467b None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:15.696529 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614cd0cd-e937-4567-8660-be5fd1fef0e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:15.697811 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614cd0cd-e937-4567-8660-be5fd1fef0e3 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:15.698314 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614cd0cd-e937-4567-8660-be5fd1fef0e3 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:15.698789 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614cd0cd-e937-4567-8660-be5fd1fef0e3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:15.712819 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614cd0cd-e937-4567-8660-be5fd1fef0e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 17:04:15.721607 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-614cd0cd-e937-4567-8660-be5fd1fef0e3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 17:04:15.721607 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:04:15.721607 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:04:15.721607 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:04:15.721607 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:04:15.721607 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:04:15.721607 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:04:15.721607 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:04:15.721607 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:04:15.721607 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:04:15.721607 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:04:15.721607 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:04:15.721607 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 17:04:15.721607 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 17:04:15.721607 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 17:04:15.721607 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 17:04:15.722618 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 17:04:15.722618 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 17:04:15.722618 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 17:04:15.722618 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 17:04:15.722618 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:04:15.722618 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:04:15.722618 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:04:15.722618 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:04:15.722618 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:04:15.722618 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:04:15.722618 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:04:15.722618 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Jul 14 17:04:15.722618 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:04:15.722618 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:04:15.722618 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:04:15.722618 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:04:15.723436 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:04:15.723436 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:04:15.723436 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:04:15.723436 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:04:15.723436 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 17:04:15.723436 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 17:04:15.723436 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 17:04:15.723436 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 17:04:15.723436 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 17:04:15.723436 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 17:04:15.723436 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 17:04:15.723436 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Jul 14 17:04:15.726470 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 151/313] 10.222.0.136 () {56 vars in 1104 bytes} [Thu Jul 14 17:04:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:04:15.733272 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf0c719-aa61-4b80-bbca-3307c7f6aba5 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:15.847821 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf0c719-aa61-4b80-bbca-3307c7f6aba5 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:15.883479 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1b2996-07e2-4150-8355-0434e7e1e2eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:15.884547 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1b2996-07e2-4150-8355-0434e7e1e2eb None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:15.885042 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1b2996-07e2-4150-8355-0434e7e1e2eb None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:15.885525 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1b2996-07e2-4150-8355-0434e7e1e2eb None admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:15.886618 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1b2996-07e2-4150-8355-0434e7e1e2eb None admin] RBAC: Adding query filter params (name=reader) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:04:15.887134 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1b2996-07e2-4150-8355-0434e7e1e2eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:15.888768 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1b2996-07e2-4150-8355-0434e7e1e2eb None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:15.898608 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 163/314] 10.222.0.136 () {56 vars in 1106 bytes} [Thu Jul 14 17:04:15 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:04:15.904486 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614cd0cd-e937-4567-8660-be5fd1fef0e3 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:16.009085 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:16.012457 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614cd0cd-e937-4567-8660-be5fd1fef0e3 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:16.049198 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a8c9ef-608f-4f92-a663-603b065327f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:16.050504 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a8c9ef-608f-4f92-a663-603b065327f3 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:16.051038 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a8c9ef-608f-4f92-a663-603b065327f3 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:16.051518 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a8c9ef-608f-4f92-a663-603b065327f3 None admin] PATH_INFO: `/v3/users/108d6d251cf74b26ad46d7d78d319f1c` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:16.053119 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a8c9ef-608f-4f92-a663-603b065327f3 None admin] RBAC: Authorizing `identity:get_user(user_id=108d6d251cf74b26ad46d7d78d319f1c)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:16.054846 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a8c9ef-608f-4f92-a663-603b065327f3 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:16.056726 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 152/315] 10.222.0.136 () {56 vars in 1182 bytes} [Thu Jul 14 17:04:15 2022] GET /identity/v3/users/108d6d251cf74b26ad46d7d78d319f1c => generated 298 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:04:16.062575 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1b2996-07e2-4150-8355-0434e7e1e2eb None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:16.116390 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:16.175736 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1b2996-07e2-4150-8355-0434e7e1e2eb None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:16.215224 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6184da-ee1a-41db-bae4-fb626c848d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:16.215611 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6184da-ee1a-41db-bae4-fb626c848d6c None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:16.215898 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6184da-ee1a-41db-bae4-fb626c848d6c None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:16.216173 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6184da-ee1a-41db-bae4-fb626c848d6c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:16.299754 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6184da-ee1a-41db-bae4-fb626c848d6c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:16.301239 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6184da-ee1a-41db-bae4-fb626c848d6c None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:16.353681 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:16.407284 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 164/316] 10.222.0.136 () {58 vars in 1287 bytes} [Thu Jul 14 17:04:16 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 17:04:16.413344 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a8c9ef-608f-4f92-a663-603b065327f3 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:16.518384 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a8c9ef-608f-4f92-a663-603b065327f3 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:16.555428 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de58b5d9-e12c-461e-baf4-de333218e99b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:16.556388 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de58b5d9-e12c-461e-baf4-de333218e99b None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:16.556675 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de58b5d9-e12c-461e-baf4-de333218e99b None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:16.556952 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de58b5d9-e12c-461e-baf4-de333218e99b None admin] PATH_INFO: `/v3/projects/dc58de68345f40498e25fd3ab4626f7f` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:16.558183 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de58b5d9-e12c-461e-baf4-de333218e99b None admin] RBAC: Authorizing `identity:get_project(project_id=dc58de68345f40498e25fd3ab4626f7f)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:16.559782 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de58b5d9-e12c-461e-baf4-de333218e99b None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:16.565883 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 153/317] 10.222.0.136 () {56 vars in 1191 bytes} [Thu Jul 14 17:04:16 2022] GET /identity/v3/projects/dc58de68345f40498e25fd3ab4626f7f => generated 303 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 17:04:16.567686 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6184da-ee1a-41db-bae4-fb626c848d6c None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:16.675867 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6184da-ee1a-41db-bae4-fb626c848d6c None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:16.711018 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28275d12-f47b-4387-94eb-a8a9eb6f1abe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:16.711679 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28275d12-f47b-4387-94eb-a8a9eb6f1abe None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:16.711965 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28275d12-f47b-4387-94eb-a8a9eb6f1abe None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:16.712245 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28275d12-f47b-4387-94eb-a8a9eb6f1abe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:16.713077 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28275d12-f47b-4387-94eb-a8a9eb6f1abe None admin] RBAC: Adding query filter params (role.id=2df0ddb31c5141c496d5705ff0dd2bc0, scope.project.id=dc58de68345f40498e25fd3ab4626f7f, user.id=108d6d251cf74b26ad46d7d78d319f1c) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:04:16.713394 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28275d12-f47b-4387-94eb-a8a9eb6f1abe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:16.714860 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28275d12-f47b-4387-94eb-a8a9eb6f1abe None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:16.721200 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 165/318] 10.222.0.136 () {56 vars in 1379 bytes} [Thu Jul 14 17:04:16 2022] GET /identity/v3/role_assignments?user.id=108d6d251cf74b26ad46d7d78d319f1c&scope.project.id=dc58de68345f40498e25fd3ab4626f7f&role.id=2df0ddb31c5141c496d5705ff0dd2bc0 => generated 610 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:04:17.196741 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae35d29c-3820-4bd4-a605-3d883194565a None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:17.197285 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae35d29c-3820-4bd4-a605-3d883194565a None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:17.197285 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae35d29c-3820-4bd4-a605-3d883194565a None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:17.198703 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 154/319] 10.222.0.136 () {54 vars in 931 bytes} [Thu Jul 14 17:04:17 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:04:17.204073 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fc76fc-4d24-4e4a-bb65-7a1497d887ba None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:17.204365 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fc76fc-4d24-4e4a-bb65-7a1497d887ba None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:17.204648 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fc76fc-4d24-4e4a-bb65-7a1497d887ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:17.225215 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-49fc76fc-4d24-4e4a-bb65-7a1497d887ba None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:04:17.226432 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-49fc76fc-4d24-4e4a-bb65-7a1497d887ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:04:17.236596 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:17.301395 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 166/320] 10.222.0.136 () {58 vars in 1028 bytes} [Thu Jul 14 17:04:17 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 17:04:17.326000 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae35d29c-3820-4bd4-a605-3d883194565a None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:17.365710 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:17.434936 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae35d29c-3820-4bd4-a605-3d883194565a None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:17.439484 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49898451-f411-4247-adb1-145742878491 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:17.439839 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49898451-f411-4247-adb1-145742878491 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:17.440236 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49898451-f411-4247-adb1-145742878491 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:17.441845 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 167/321] 10.222.0.136 () {54 vars in 931 bytes} [Thu Jul 14 17:04:17 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 14 17:04:17.447545 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1a4b95-6dec-48a9-a23d-2ad1484c19ed None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:17.447765 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1a4b95-6dec-48a9-a23d-2ad1484c19ed None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:17.448042 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1a4b95-6dec-48a9-a23d-2ad1484c19ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:17.465793 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-8b1a4b95-6dec-48a9-a23d-2ad1484c19ed None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:04:17.466949 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-8b1a4b95-6dec-48a9-a23d-2ad1484c19ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:04:17.477254 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0075b1d6-7180-461c-864c-29b69e18f892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:17.478114 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0075b1d6-7180-461c-864c-29b69e18f892 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:17.478401 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0075b1d6-7180-461c-864c-29b69e18f892 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:17.478690 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0075b1d6-7180-461c-864c-29b69e18f892 None admin] PATH_INFO: `/v3/domains/default` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:17.479881 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0075b1d6-7180-461c-864c-29b69e18f892 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:17.481608 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0075b1d6-7180-461c-864c-29b69e18f892 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:17.483258 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 155/322] 10.222.0.136 () {56 vars in 1113 bytes} [Thu Jul 14 17:04:17 2022] GET /identity/v3/domains/default => generated 200 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 17:04:17.488622 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0075b1d6-7180-461c-864c-29b69e18f892 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:17.552532 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 168/323] 10.222.0.136 () {58 vars in 1028 bytes} [Thu Jul 14 17:04:17 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 17:04:17.576574 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1a4b95-6dec-48a9-a23d-2ad1484c19ed None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:17.600310 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0075b1d6-7180-461c-864c-29b69e18f892 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:17.603316 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:17.641047 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81c07a7-78fc-4d5a-80c8-e17b38ea8767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:17.641755 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81c07a7-78fc-4d5a-80c8-e17b38ea8767 None admin] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:17.642038 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81c07a7-78fc-4d5a-80c8-e17b38ea8767 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:17.642322 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81c07a7-78fc-4d5a-80c8-e17b38ea8767 None admin] PATH_INFO: `/v3/groups` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:17.643001 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81c07a7-78fc-4d5a-80c8-e17b38ea8767 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:17.644461 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81c07a7-78fc-4d5a-80c8-e17b38ea8767 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:17.660100 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:17.660691 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 156/324] 10.222.0.136 () {60 vars in 1139 bytes} [Thu Jul 14 17:04:17 2022] POST /identity/v3/groups => generated 227 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 17:04:17.693660 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1a4b95-6dec-48a9-a23d-2ad1484c19ed None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:17.733751 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d35b53-3011-4842-ac19-5eddda2d2b7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:17.734873 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d35b53-3011-4842-ac19-5eddda2d2b7d None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:17.735326 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d35b53-3011-4842-ac19-5eddda2d2b7d None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:17.735769 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d35b53-3011-4842-ac19-5eddda2d2b7d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:17.748245 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d35b53-3011-4842-ac19-5eddda2d2b7d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 17:04:17.756671 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-75d35b53-3011-4842-ac19-5eddda2d2b7d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 17:04:17.756671 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:04:17.756671 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:04:17.756671 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:04:17.756671 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:04:17.756671 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:04:17.756671 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:04:17.756671 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:04:17.756671 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:04:17.756671 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:04:17.756671 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:04:17.756671 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:04:17.756671 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 17:04:17.756671 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 17:04:17.756671 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 17:04:17.756671 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 17:04:17.757630 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 17:04:17.757630 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 17:04:17.757630 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 17:04:17.757630 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 17:04:17.757630 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:04:17.757630 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:04:17.757630 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:04:17.757630 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:04:17.757630 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:04:17.757630 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:04:17.757630 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:04:17.757630 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Jul 14 17:04:17.757630 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:04:17.757630 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:04:17.757630 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:04:17.757630 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:04:17.758433 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:04:17.758433 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:04:17.758433 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:04:17.758433 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:04:17.758433 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 17:04:17.758433 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 17:04:17.758433 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 17:04:17.758433 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 17:04:17.758433 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 17:04:17.758433 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 17:04:17.758433 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 17:04:17.758433 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Jul 14 17:04:17.764253 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 169/325] 10.222.0.136 () {56 vars in 1104 bytes} [Thu Jul 14 17:04:17 2022] GET /identity/v3/roles/reader => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 17:04:17.766043 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81c07a7-78fc-4d5a-80c8-e17b38ea8767 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:17.903663 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81c07a7-78fc-4d5a-80c8-e17b38ea8767 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:17.943153 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c6db69-0d9f-45fc-9070-d85248de67c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:17.944169 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c6db69-0d9f-45fc-9070-d85248de67c7 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:17.944642 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c6db69-0d9f-45fc-9070-d85248de67c7 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:17.945103 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c6db69-0d9f-45fc-9070-d85248de67c7 None admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:17.946133 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c6db69-0d9f-45fc-9070-d85248de67c7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:04:17.946644 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c6db69-0d9f-45fc-9070-d85248de67c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:17.948206 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c6db69-0d9f-45fc-9070-d85248de67c7 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:17.958181 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 157/326] 10.222.0.136 () {56 vars in 1106 bytes} [Thu Jul 14 17:04:17 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 17:04:17.964747 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d35b53-3011-4842-ac19-5eddda2d2b7d None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:18.050289 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a647c809-4727-4f6e-8055-f0e5ebca89be None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:18.050527 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a647c809-4727-4f6e-8055-f0e5ebca89be None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:18.050778 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a647c809-4727-4f6e-8055-f0e5ebca89be None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:18.052860 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 158/327] 10.222.0.136 () {54 vars in 931 bytes} [Thu Jul 14 17:04:18 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 14 17:04:18.058776 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa17e16-4db5-42cd-8484-fcd572f3017c None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:18.059066 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa17e16-4db5-42cd-8484-fcd572f3017c None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:18.059347 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa17e16-4db5-42cd-8484-fcd572f3017c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:18.078474 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-3aa17e16-4db5-42cd-8484-fcd572f3017c None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:04:18.079916 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-3aa17e16-4db5-42cd-8484-fcd572f3017c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:04:18.082808 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d35b53-3011-4842-ac19-5eddda2d2b7d None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:18.113402 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:18.127102 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93458e95-af79-4b73-bed1-f1281022d268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:18.128240 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93458e95-af79-4b73-bed1-f1281022d268 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:18.128528 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93458e95-af79-4b73-bed1-f1281022d268 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:18.129124 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93458e95-af79-4b73-bed1-f1281022d268 None admin] PATH_INFO: `/v3/users/f9c8aae316ae458c8fcecc741a32ca77` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:18.130097 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93458e95-af79-4b73-bed1-f1281022d268 None admin] RBAC: Authorizing `identity:get_user(user_id=f9c8aae316ae458c8fcecc741a32ca77)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:18.132053 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93458e95-af79-4b73-bed1-f1281022d268 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:18.134099 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 170/328] 10.222.0.136 () {56 vars in 1182 bytes} [Thu Jul 14 17:04:17 2022] GET /identity/v3/users/f9c8aae316ae458c8fcecc741a32ca77 => generated 294 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:04:18.139406 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93458e95-af79-4b73-bed1-f1281022d268 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:18.142404 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:18.195064 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 159/329] 10.222.0.136 () {58 vars in 1028 bytes} [Thu Jul 14 17:04:18 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 17:04:18.222450 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa17e16-4db5-42cd-8484-fcd572f3017c None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:18.278921 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93458e95-af79-4b73-bed1-f1281022d268 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:18.324993 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6bc7f5-b601-4fe4-b8c2-79fcf0028edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:18.326852 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6bc7f5-b601-4fe4-b8c2-79fcf0028edb None admin] REQUEST_METHOD: `PUT` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:18.327292 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6bc7f5-b601-4fe4-b8c2-79fcf0028edb None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:18.327706 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6bc7f5-b601-4fe4-b8c2-79fcf0028edb None admin] PATH_INFO: `/v3/system/users/f9c8aae316ae458c8fcecc741a32ca77/roles/2df0ddb31c5141c496d5705ff0dd2bc0` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:18.329427 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6bc7f5-b601-4fe4-b8c2-79fcf0028edb None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=f9c8aae316ae458c8fcecc741a32ca77, role_id=2df0ddb31c5141c496d5705ff0dd2bc0)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:18.331476 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6bc7f5-b601-4fe4-b8c2-79fcf0028edb None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:18.343603 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 171/330] 10.222.0.136 () {58 vars in 1339 bytes} [Thu Jul 14 17:04:18 2022] PUT /identity/v3/system/users/f9c8aae316ae458c8fcecc741a32ca77/roles/2df0ddb31c5141c496d5705ff0dd2bc0 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 17:04:18.345208 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa17e16-4db5-42cd-8484-fcd572f3017c None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:18.391442 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5d31eb-e426-4ae4-bd95-fc89669e4430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:18.392258 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5d31eb-e426-4ae4-bd95-fc89669e4430 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:18.392619 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5d31eb-e426-4ae4-bd95-fc89669e4430 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:18.392868 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5d31eb-e426-4ae4-bd95-fc89669e4430 None admin] PATH_INFO: `/v3/roles/member` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:18.405536 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5d31eb-e426-4ae4-bd95-fc89669e4430 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 17:04:18.414524 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-2c5d31eb-e426-4ae4-bd95-fc89669e4430 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 17:04:18.414524 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:04:18.414524 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:04:18.414524 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:04:18.414524 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:04:18.414524 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:04:18.414524 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:04:18.414524 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:04:18.414524 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:04:18.414524 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:04:18.414524 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:04:18.414524 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:04:18.414524 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 17:04:18.414524 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 17:04:18.414524 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 17:04:18.414524 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 17:04:18.415490 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 17:04:18.415490 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 17:04:18.415490 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 17:04:18.415490 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 17:04:18.415490 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:04:18.415490 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:04:18.415490 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:04:18.415490 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:04:18.415490 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:04:18.415490 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:04:18.415490 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:04:18.415490 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Jul 14 17:04:18.415490 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:04:18.415490 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:04:18.415490 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:04:18.415490 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:04:18.416304 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:04:18.416304 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:04:18.416304 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:04:18.416304 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:04:18.416304 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 17:04:18.416304 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 17:04:18.416304 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 17:04:18.416304 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 17:04:18.416304 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 17:04:18.416304 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 17:04:18.416304 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 17:04:18.416304 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Jul 14 17:04:18.416304 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 160/331] 10.222.0.136 () {56 vars in 1104 bytes} [Thu Jul 14 17:04:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 17:04:18.422473 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6bc7f5-b601-4fe4-b8c2-79fcf0028edb None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:18.503596 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:18.549024 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6bc7f5-b601-4fe4-b8c2-79fcf0028edb None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:18.589639 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d1ad9d-64ff-4e01-8c59-35d162c1910d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:18.590285 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d1ad9d-64ff-4e01-8c59-35d162c1910d None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:18.590575 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d1ad9d-64ff-4e01-8c59-35d162c1910d None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:18.590849 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d1ad9d-64ff-4e01-8c59-35d162c1910d None admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:18.591665 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d1ad9d-64ff-4e01-8c59-35d162c1910d None admin] RBAC: Adding query filter params (name=member) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:04:18.591977 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d1ad9d-64ff-4e01-8c59-35d162c1910d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:18.593375 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d1ad9d-64ff-4e01-8c59-35d162c1910d None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:18.603121 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 172/332] 10.222.0.136 () {56 vars in 1106 bytes} [Thu Jul 14 17:04:18 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:04:18.609133 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5d31eb-e426-4ae4-bd95-fc89669e4430 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:18.629252 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:18.733715 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5d31eb-e426-4ae4-bd95-fc89669e4430 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:18.780473 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cbc0b9-41d1-4737-8767-d60d83813e7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:18.781747 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cbc0b9-41d1-4737-8767-d60d83813e7e None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:18.782254 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cbc0b9-41d1-4737-8767-d60d83813e7e None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:18.782726 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cbc0b9-41d1-4737-8767-d60d83813e7e None admin] PATH_INFO: `/v3/users/03cba826dbe24b0ca8b124742bfb5d97` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:18.784156 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cbc0b9-41d1-4737-8767-d60d83813e7e None admin] RBAC: Authorizing `identity:get_user(user_id=03cba826dbe24b0ca8b124742bfb5d97)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:18.785852 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cbc0b9-41d1-4737-8767-d60d83813e7e None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:18.788611 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 161/333] 10.222.0.136 () {56 vars in 1182 bytes} [Thu Jul 14 17:04:18 2022] GET /identity/v3/users/03cba826dbe24b0ca8b124742bfb5d97 => generated 294 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:04:18.794186 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d1ad9d-64ff-4e01-8c59-35d162c1910d None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:18.938916 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d1ad9d-64ff-4e01-8c59-35d162c1910d None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:18.974804 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:18.985097 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73b5b73-6c26-4b73-8845-78f1f08d0806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:18.985904 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73b5b73-6c26-4b73-8845-78f1f08d0806 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:18.986192 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73b5b73-6c26-4b73-8845-78f1f08d0806 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:18.986471 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73b5b73-6c26-4b73-8845-78f1f08d0806 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:18.987307 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73b5b73-6c26-4b73-8845-78f1f08d0806 None admin] RBAC: Adding query filter params (role.id=7441b1b1ab104537addd90a2471822f3, user.id=03cba826dbe24b0ca8b124742bfb5d97, scope.system=all) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:04:18.987625 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73b5b73-6c26-4b73-8845-78f1f08d0806 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:18.989206 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73b5b73-6c26-4b73-8845-78f1f08d0806 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:19.007654 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 173/334] 10.222.0.136 () {56 vars in 1313 bytes} [Thu Jul 14 17:04:18 2022] GET /identity/v3/role_assignments?user.id=03cba826dbe24b0ca8b124742bfb5d97&scope.system=all&role.id=7441b1b1ab104537addd90a2471822f3 => generated 512 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:04:21.056247 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b83023-9951-474e-ba56-5e77c0fd1afb None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:21.057318 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b83023-9951-474e-ba56-5e77c0fd1afb None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:21.057856 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b83023-9951-474e-ba56-5e77c0fd1afb None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:21.059765 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 162/335] 10.222.0.136 () {54 vars in 931 bytes} [Thu Jul 14 17:04:21 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:04:21.067049 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1f26bf-e7c9-4948-8f92-bb92b5500605 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:21.068105 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1f26bf-e7c9-4948-8f92-bb92b5500605 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:21.068785 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1f26bf-e7c9-4948-8f92-bb92b5500605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:21.098609 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-0e1f26bf-e7c9-4948-8f92-bb92b5500605 None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:04:21.101047 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-0e1f26bf-e7c9-4948-8f92-bb92b5500605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:04:21.192154 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 174/336] 10.222.0.136 () {58 vars in 1028 bytes} [Thu Jul 14 17:04:21 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 17:04:21.227563 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b83023-9951-474e-ba56-5e77c0fd1afb None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:21.353282 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:21.378283 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b83023-9951-474e-ba56-5e77c0fd1afb None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:21.431924 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a142890-4ca1-4b71-a48a-af7bda7d9881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:21.433078 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a142890-4ca1-4b71-a48a-af7bda7d9881 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:21.433634 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a142890-4ca1-4b71-a48a-af7bda7d9881 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:21.434108 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a142890-4ca1-4b71-a48a-af7bda7d9881 None admin] PATH_INFO: `/v3/roles/member` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:21.446805 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a142890-4ca1-4b71-a48a-af7bda7d9881 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 17:04:21.454917 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-0a142890-4ca1-4b71-a48a-af7bda7d9881 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 17:04:21.454917 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:04:21.454917 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:04:21.454917 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:04:21.454917 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:04:21.454917 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:04:21.454917 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:04:21.454917 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:04:21.454917 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:04:21.454917 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:04:21.454917 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:04:21.454917 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:04:21.454917 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 17:04:21.454917 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 17:04:21.454917 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 17:04:21.454917 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 17:04:21.455862 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 17:04:21.455862 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 17:04:21.455862 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 17:04:21.455862 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 17:04:21.455862 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:04:21.455862 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:04:21.455862 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:04:21.455862 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:04:21.455862 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:04:21.455862 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:04:21.455862 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:04:21.455862 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Jul 14 17:04:21.455862 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:04:21.455862 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:04:21.455862 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:04:21.455862 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:04:21.456670 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:04:21.456670 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:04:21.456670 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:04:21.456670 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:04:21.456670 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 17:04:21.456670 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 17:04:21.456670 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 17:04:21.456670 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 17:04:21.456670 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 17:04:21.456670 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 17:04:21.456670 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 17:04:21.456670 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Jul 14 17:04:21.457273 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af201c7e-e97b-4a40-98df-4fd0ade9cc8f None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:21.457273 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af201c7e-e97b-4a40-98df-4fd0ade9cc8f None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:21.457273 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af201c7e-e97b-4a40-98df-4fd0ade9cc8f None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:21.457875 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 175/337] 10.222.0.136 () {54 vars in 931 bytes} [Thu Jul 14 17:04:21 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:04:21.460562 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 163/338] 10.222.0.136 () {56 vars in 1104 bytes} [Thu Jul 14 17:04:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:04:21.472763 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a142890-4ca1-4b71-a48a-af7bda7d9881 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:21.473123 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904f9bd4-c28e-4927-8801-ab16522f279c None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:21.473560 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904f9bd4-c28e-4927-8801-ab16522f279c None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:21.473884 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904f9bd4-c28e-4927-8801-ab16522f279c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:21.503255 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-904f9bd4-c28e-4927-8801-ab16522f279c None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:04:21.504542 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-904f9bd4-c28e-4927-8801-ab16522f279c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:04:21.662051 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 176/339] 10.222.0.136 () {58 vars in 1028 bytes} [Thu Jul 14 17:04:21 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 17:04:21.663591 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96abee44-4d7e-41e4-b246-26ab85533b54 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:21.663881 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96abee44-4d7e-41e4-b246-26ab85533b54 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:21.664162 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96abee44-4d7e-41e4-b246-26ab85533b54 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:21.665573 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 177/340] 10.222.0.136 () {54 vars in 931 bytes} [Thu Jul 14 17:04:21 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:04:21.681382 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a142890-4ca1-4b71-a48a-af7bda7d9881 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:21.699483 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b023dc-31d1-4ee3-928d-b816b02f1d03 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:21.699778 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b023dc-31d1-4ee3-928d-b816b02f1d03 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:21.700042 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b023dc-31d1-4ee3-928d-b816b02f1d03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:21.725683 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-89b023dc-31d1-4ee3-928d-b816b02f1d03 None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:04:21.726892 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-89b023dc-31d1-4ee3-928d-b816b02f1d03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:04:21.749814 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf3d939-6bd2-4984-aa5f-588da0a6c142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:21.750510 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf3d939-6bd2-4984-aa5f-588da0a6c142 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:21.750799 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf3d939-6bd2-4984-aa5f-588da0a6c142 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:21.751083 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf3d939-6bd2-4984-aa5f-588da0a6c142 None admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:21.751844 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf3d939-6bd2-4984-aa5f-588da0a6c142 None admin] RBAC: Adding query filter params (name=member) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:04:21.752160 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf3d939-6bd2-4984-aa5f-588da0a6c142 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:21.753630 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf3d939-6bd2-4984-aa5f-588da0a6c142 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:21.770382 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 164/341] 10.222.0.136 () {56 vars in 1106 bytes} [Thu Jul 14 17:04:21 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:04:21.772316 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf3d939-6bd2-4984-aa5f-588da0a6c142 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:21.784442 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:21.839409 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:21.896190 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 178/342] 10.222.0.136 () {58 vars in 1028 bytes} [Thu Jul 14 17:04:21 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 17:04:21.897091 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b023dc-31d1-4ee3-928d-b816b02f1d03 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:21.986433 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf3d939-6bd2-4984-aa5f-588da0a6c142 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:22.051274 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e400e0-cd43-4702-81d1-1aea9a0b980b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:22.052153 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e400e0-cd43-4702-81d1-1aea9a0b980b None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:22.052444 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e400e0-cd43-4702-81d1-1aea9a0b980b None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:22.052740 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e400e0-cd43-4702-81d1-1aea9a0b980b None admin] PATH_INFO: `/v3/roles/member` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:22.077564 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e400e0-cd43-4702-81d1-1aea9a0b980b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 17:04:22.088436 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-22e400e0-cd43-4702-81d1-1aea9a0b980b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 17:04:22.088436 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:04:22.088436 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:04:22.088436 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:04:22.088436 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:04:22.088436 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:04:22.088436 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:04:22.088436 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:04:22.088436 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:04:22.088436 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:04:22.088436 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:04:22.088436 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:04:22.088436 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 17:04:22.088436 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 17:04:22.088436 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 17:04:22.088436 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 17:04:22.089396 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 17:04:22.089396 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 17:04:22.089396 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 17:04:22.089396 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 17:04:22.089396 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:04:22.089396 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:04:22.089396 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:04:22.089396 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:04:22.089396 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:04:22.089396 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:04:22.089396 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:04:22.089396 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Jul 14 17:04:22.089396 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:04:22.089396 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:04:22.089396 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:04:22.089396 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:04:22.090267 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:04:22.090267 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:04:22.090267 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:04:22.090267 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:04:22.090267 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 17:04:22.090267 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 17:04:22.090267 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 17:04:22.090267 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 17:04:22.090267 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 17:04:22.090267 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 17:04:22.090267 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 17:04:22.090267 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Jul 14 17:04:22.095758 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 165/343] 10.222.0.136 () {56 vars in 1104 bytes} [Thu Jul 14 17:04:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:04:22.097500 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e400e0-cd43-4702-81d1-1aea9a0b980b None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:22.121537 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b023dc-31d1-4ee3-928d-b816b02f1d03 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:22.172295 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164b1386-45c2-434a-9292-0fcd3883f5e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:22.173505 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164b1386-45c2-434a-9292-0fcd3883f5e4 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:22.173930 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164b1386-45c2-434a-9292-0fcd3883f5e4 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:22.174216 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164b1386-45c2-434a-9292-0fcd3883f5e4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:22.224829 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:22.248444 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:22.272647 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e400e0-cd43-4702-81d1-1aea9a0b980b None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:22.278996 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164b1386-45c2-434a-9292-0fcd3883f5e4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:22.280524 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164b1386-45c2-434a-9292-0fcd3883f5e4 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:22.312362 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12c42d8-6be7-47c2-981f-41121763d184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:22.313190 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12c42d8-6be7-47c2-981f-41121763d184 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:22.313467 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12c42d8-6be7-47c2-981f-41121763d184 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:22.313945 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12c42d8-6be7-47c2-981f-41121763d184 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:22.327210 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12c42d8-6be7-47c2-981f-41121763d184 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 17:04:22.337263 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-f12c42d8-6be7-47c2-981f-41121763d184 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 17:04:22.337263 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:04:22.337263 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:04:22.337263 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:04:22.337263 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:04:22.337263 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:04:22.337263 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:04:22.337263 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:04:22.337263 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:04:22.337263 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:04:22.337263 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:04:22.337263 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:04:22.337263 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 17:04:22.337263 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 17:04:22.337263 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 17:04:22.337263 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 17:04:22.338453 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 17:04:22.338453 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 17:04:22.338453 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 17:04:22.338453 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 17:04:22.338453 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:04:22.338453 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:04:22.338453 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:04:22.338453 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:04:22.338453 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:04:22.338453 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:04:22.338453 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:04:22.338453 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Jul 14 17:04:22.338453 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:04:22.338453 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:04:22.338453 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:04:22.338453 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:04:22.339461 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:04:22.339461 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:04:22.339461 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:04:22.339461 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:04:22.339461 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 17:04:22.339461 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 17:04:22.339461 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 17:04:22.339461 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 17:04:22.339461 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 17:04:22.339461 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 17:04:22.339461 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 17:04:22.339461 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Jul 14 17:04:22.341416 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 166/344] 10.222.0.136 () {56 vars in 1119 bytes} [Thu Jul 14 17:04:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:04:22.342435 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12c42d8-6be7-47c2-981f-41121763d184 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:22.393298 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 179/345] 10.222.0.136 () {58 vars in 1287 bytes} [Thu Jul 14 17:04:21 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 497 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 17:04:22.394663 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a24f91-5afa-4921-afcc-473569d854dd None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:22.394954 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a24f91-5afa-4921-afcc-473569d854dd None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:22.395237 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a24f91-5afa-4921-afcc-473569d854dd None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:22.398688 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 180/346] 10.222.0.136 () {54 vars in 931 bytes} [Thu Jul 14 17:04:22 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:04:22.398688 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a24f91-5afa-4921-afcc-473569d854dd None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:22.481397 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12c42d8-6be7-47c2-981f-41121763d184 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:22.514950 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:22.525989 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:22.541102 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa3e156-56fa-46e6-8db4-ce3909aecf9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:22.541412 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa3e156-56fa-46e6-8db4-ce3909aecf9d None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:22.542018 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa3e156-56fa-46e6-8db4-ce3909aecf9d None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:22.542306 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa3e156-56fa-46e6-8db4-ce3909aecf9d None admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:22.543062 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa3e156-56fa-46e6-8db4-ce3909aecf9d None admin] RBAC: Adding query filter params (name=member) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:04:22.543373 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa3e156-56fa-46e6-8db4-ce3909aecf9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:22.544756 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa3e156-56fa-46e6-8db4-ce3909aecf9d None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:22.546633 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a24f91-5afa-4921-afcc-473569d854dd None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:22.557715 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 167/347] 10.222.0.136 () {56 vars in 1106 bytes} [Thu Jul 14 17:04:22 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:04:22.558422 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa3e156-56fa-46e6-8db4-ce3909aecf9d None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:22.597772 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227e087a-7fab-43ea-8ff2-2d4fbbcfc2db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:22.598452 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227e087a-7fab-43ea-8ff2-2d4fbbcfc2db None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:22.598740 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227e087a-7fab-43ea-8ff2-2d4fbbcfc2db None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:22.599218 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227e087a-7fab-43ea-8ff2-2d4fbbcfc2db None admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:22.599962 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227e087a-7fab-43ea-8ff2-2d4fbbcfc2db None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:04:22.601022 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227e087a-7fab-43ea-8ff2-2d4fbbcfc2db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:22.601682 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227e087a-7fab-43ea-8ff2-2d4fbbcfc2db None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:22.611213 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 181/348] 10.222.0.136 () {56 vars in 1116 bytes} [Thu Jul 14 17:04:22 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:04:22.612485 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b131dfa8-a771-4468-aeef-c1345fb52078 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:22.612698 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b131dfa8-a771-4468-aeef-c1345fb52078 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:22.613082 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b131dfa8-a771-4468-aeef-c1345fb52078 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:22.615047 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 182/349] 10.222.0.136 () {54 vars in 931 bytes} [Thu Jul 14 17:04:22 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:04:22.616114 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cb1eed-c3ca-479c-ae32-2cc007ed36f2 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:22.616404 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cb1eed-c3ca-479c-ae32-2cc007ed36f2 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:22.621712 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cb1eed-c3ca-479c-ae32-2cc007ed36f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:22.644768 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-07cb1eed-c3ca-479c-ae32-2cc007ed36f2 None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:04:22.646363 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-07cb1eed-c3ca-479c-ae32-2cc007ed36f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:04:22.687634 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa3e156-56fa-46e6-8db4-ce3909aecf9d None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:22.731878 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0ab479-97d4-4b42-a086-c8ab74eee93f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:22.732751 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0ab479-97d4-4b42-a086-c8ab74eee93f None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:22.733044 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0ab479-97d4-4b42-a086-c8ab74eee93f None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:22.733339 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0ab479-97d4-4b42-a086-c8ab74eee93f None admin] PATH_INFO: `/v3/projects/dc58de68345f40498e25fd3ab4626f7f` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:22.734547 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0ab479-97d4-4b42-a086-c8ab74eee93f None admin] RBAC: Authorizing `identity:get_project(project_id=dc58de68345f40498e25fd3ab4626f7f)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:22.735985 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0ab479-97d4-4b42-a086-c8ab74eee93f None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:22.736617 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 183/350] 10.222.0.136 () {58 vars in 1028 bytes} [Thu Jul 14 17:04:22 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 17:04:22.737296 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cb1eed-c3ca-479c-ae32-2cc007ed36f2 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:22.737932 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 168/351] 10.222.0.136 () {56 vars in 1191 bytes} [Thu Jul 14 17:04:22 2022] GET /identity/v3/projects/dc58de68345f40498e25fd3ab4626f7f => generated 303 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:04:22.738633 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0ab479-97d4-4b42-a086-c8ab74eee93f None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:22.820039 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:22.827848 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:22.887221 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0ab479-97d4-4b42-a086-c8ab74eee93f None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:22.894841 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cb1eed-c3ca-479c-ae32-2cc007ed36f2 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:22.942476 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c04b4dd-9885-42d1-98d5-888673b4353a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:22.944233 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c04b4dd-9885-42d1-98d5-888673b4353a None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:22.944587 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c04b4dd-9885-42d1-98d5-888673b4353a None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:22.944872 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c04b4dd-9885-42d1-98d5-888673b4353a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:22.947042 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10400066-e9c2-4718-9a66-3fab6c4aeb1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:22.947683 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10400066-e9c2-4718-9a66-3fab6c4aeb1e None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:22.948024 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10400066-e9c2-4718-9a66-3fab6c4aeb1e None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:22.948242 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10400066-e9c2-4718-9a66-3fab6c4aeb1e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:23.038993 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10400066-e9c2-4718-9a66-3fab6c4aeb1e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:23.040882 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10400066-e9c2-4718-9a66-3fab6c4aeb1e None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:23.042151 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c04b4dd-9885-42d1-98d5-888673b4353a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:23.043913 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c04b4dd-9885-42d1-98d5-888673b4353a None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:23.119270 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:23.135468 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:23.176218 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 169/352] 10.222.0.136 () {58 vars in 1287 bytes} [Thu Jul 14 17:04:22 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 17:04:23.178388 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ff4623-0638-4655-b5fe-d823c312c1d6 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:23.178795 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ff4623-0638-4655-b5fe-d823c312c1d6 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:23.179086 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ff4623-0638-4655-b5fe-d823c312c1d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:23.179676 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 184/353] 10.222.0.136 () {58 vars in 1287 bytes} [Thu Jul 14 17:04:22 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 17:04:23.180845 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10400066-e9c2-4718-9a66-3fab6c4aeb1e None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:23.205768 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-a4ff4623-0638-4655-b5fe-d823c312c1d6 None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:04:23.207006 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-a4ff4623-0638-4655-b5fe-d823c312c1d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:04:23.303662 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 170/354] 10.222.0.136 () {58 vars in 1028 bytes} [Thu Jul 14 17:04:23 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 17:04:23.303853 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ff4623-0638-4655-b5fe-d823c312c1d6 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:23.329340 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10400066-e9c2-4718-9a66-3fab6c4aeb1e None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:23.382233 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173f1aa4-095a-4dc6-b353-224a04c8c3e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:23.383037 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173f1aa4-095a-4dc6-b353-224a04c8c3e8 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:23.383491 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173f1aa4-095a-4dc6-b353-224a04c8c3e8 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:23.383787 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173f1aa4-095a-4dc6-b353-224a04c8c3e8 None admin] PATH_INFO: `/v3/groups/88aff3277a984c00a5903432c1757a32` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:23.394547 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173f1aa4-095a-4dc6-b353-224a04c8c3e8 None admin] RBAC: Authorizing `identity:get_group(group_id=88aff3277a984c00a5903432c1757a32)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:23.397150 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173f1aa4-095a-4dc6-b353-224a04c8c3e8 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:23.399254 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 185/355] 10.222.0.136 () {56 vars in 1185 bytes} [Thu Jul 14 17:04:23 2022] GET /identity/v3/groups/88aff3277a984c00a5903432c1757a32 => generated 227 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:04:23.400418 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173f1aa4-095a-4dc6-b353-224a04c8c3e8 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:23.437629 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:23.440700 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:23.465446 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ff4623-0638-4655-b5fe-d823c312c1d6 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:23.506588 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bdf0be-411f-46fc-b0cb-9a1d85f78688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:23.507509 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bdf0be-411f-46fc-b0cb-9a1d85f78688 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:23.507799 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bdf0be-411f-46fc-b0cb-9a1d85f78688 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:23.508075 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bdf0be-411f-46fc-b0cb-9a1d85f78688 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:23.518709 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bdf0be-411f-46fc-b0cb-9a1d85f78688 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 17:04:23.528867 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-21bdf0be-411f-46fc-b0cb-9a1d85f78688 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 17:04:23.528867 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:04:23.528867 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:04:23.528867 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:04:23.528867 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:04:23.528867 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:04:23.528867 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:04:23.528867 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:04:23.528867 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:04:23.528867 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:04:23.528867 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:04:23.528867 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:04:23.528867 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 17:04:23.528867 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 17:04:23.528867 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 17:04:23.528867 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 17:04:23.529827 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 17:04:23.529827 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 17:04:23.529827 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 17:04:23.529827 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 17:04:23.529827 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:04:23.529827 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:04:23.529827 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:04:23.529827 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:04:23.529827 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:04:23.529827 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:04:23.529827 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:04:23.529827 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Jul 14 17:04:23.529827 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:04:23.529827 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:04:23.529827 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:04:23.529827 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:04:23.530626 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:04:23.530626 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:04:23.530626 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:04:23.530626 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:04:23.530626 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 17:04:23.530626 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 17:04:23.530626 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 17:04:23.530626 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 17:04:23.530626 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 17:04:23.530626 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 17:04:23.530626 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 17:04:23.530626 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Jul 14 17:04:23.531230 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173f1aa4-095a-4dc6-b353-224a04c8c3e8 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:23.531303 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 171/356] 10.222.0.136 () {56 vars in 1119 bytes} [Thu Jul 14 17:04:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:04:23.531303 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bdf0be-411f-46fc-b0cb-9a1d85f78688 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:23.577649 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3680a05-65a4-4de4-b62c-b8d627cc8079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:23.578822 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3680a05-65a4-4de4-b62c-b8d627cc8079 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:23.578822 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3680a05-65a4-4de4-b62c-b8d627cc8079 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:23.579045 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3680a05-65a4-4de4-b62c-b8d627cc8079 None admin] PATH_INFO: `/v3/projects/8bd70064655e4aa5832910aaa0dd0116` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:23.581872 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3680a05-65a4-4de4-b62c-b8d627cc8079 None admin] RBAC: Authorizing `identity:get_project(project_id=8bd70064655e4aa5832910aaa0dd0116)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:23.584308 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3680a05-65a4-4de4-b62c-b8d627cc8079 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:23.586526 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 186/357] 10.222.0.136 () {56 vars in 1191 bytes} [Thu Jul 14 17:04:23 2022] GET /identity/v3/projects/8bd70064655e4aa5832910aaa0dd0116 => generated 299 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:04:23.587258 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3680a05-65a4-4de4-b62c-b8d627cc8079 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:23.669161 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bdf0be-411f-46fc-b0cb-9a1d85f78688 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:23.705425 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845f9848-66bf-4ab5-b444-1d4358ccabc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:23.706630 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845f9848-66bf-4ab5-b444-1d4358ccabc6 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:23.707082 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845f9848-66bf-4ab5-b444-1d4358ccabc6 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:23.709991 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845f9848-66bf-4ab5-b444-1d4358ccabc6 None admin] PATH_INFO: `/v3/projects/8bd70064655e4aa5832910aaa0dd0116` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:23.710124 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:23.710310 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845f9848-66bf-4ab5-b444-1d4358ccabc6 None admin] RBAC: Authorizing `identity:get_project(project_id=8bd70064655e4aa5832910aaa0dd0116)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:23.711463 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845f9848-66bf-4ab5-b444-1d4358ccabc6 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:23.712395 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3680a05-65a4-4de4-b62c-b8d627cc8079 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:23.713507 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 172/358] 10.222.0.136 () {56 vars in 1191 bytes} [Thu Jul 14 17:04:23 2022] GET /identity/v3/projects/8bd70064655e4aa5832910aaa0dd0116 => generated 299 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:04:23.714339 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845f9848-66bf-4ab5-b444-1d4358ccabc6 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:23.732013 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:23.762164 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e136ef-9c83-4bdc-85b7-dd07888533ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:23.762970 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e136ef-9c83-4bdc-85b7-dd07888533ec None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:23.763247 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e136ef-9c83-4bdc-85b7-dd07888533ec None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:23.763520 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e136ef-9c83-4bdc-85b7-dd07888533ec None admin] PATH_INFO: `/v3/roles/reader` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:23.776233 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e136ef-9c83-4bdc-85b7-dd07888533ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 17:04:23.784444 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-24e136ef-9c83-4bdc-85b7-dd07888533ec None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 17:04:23.784444 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:04:23.784444 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:04:23.784444 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:04:23.784444 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:04:23.784444 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:04:23.784444 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:04:23.784444 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:04:23.784444 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:04:23.784444 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:04:23.784444 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:04:23.784444 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:04:23.784444 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 17:04:23.784444 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 17:04:23.784444 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 17:04:23.784444 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 17:04:23.785372 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 17:04:23.785372 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 17:04:23.785372 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 17:04:23.785372 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 17:04:23.785372 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:04:23.785372 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:04:23.785372 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:04:23.785372 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:04:23.785372 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:04:23.785372 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:04:23.785372 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:04:23.785372 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Jul 14 17:04:23.785372 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:04:23.785372 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:04:23.785372 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:04:23.785372 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:04:23.786277 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:04:23.786277 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:04:23.786277 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:04:23.786277 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:04:23.786277 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 17:04:23.786277 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 17:04:23.786277 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 17:04:23.786277 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 17:04:23.786277 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 17:04:23.786277 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 17:04:23.786277 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 17:04:23.786277 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Jul 14 17:04:23.790003 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 187/359] 10.222.0.136 () {56 vars in 1104 bytes} [Thu Jul 14 17:04:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:04:23.791367 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bde00d3-75d7-4faf-9d91-4615c6a8fa6c None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:23.792380 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bde00d3-75d7-4faf-9d91-4615c6a8fa6c None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:23.792380 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bde00d3-75d7-4faf-9d91-4615c6a8fa6c None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:23.793731 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 188/360] 10.222.0.136 () {54 vars in 931 bytes} [Thu Jul 14 17:04:23 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:04:23.794993 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bde00d3-75d7-4faf-9d91-4615c6a8fa6c None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:23.839518 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845f9848-66bf-4ab5-b444-1d4358ccabc6 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:23.880464 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2ccb28-69f6-4734-a931-c4f2a7dedac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:23.881202 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2ccb28-69f6-4734-a931-c4f2a7dedac3 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:23.881489 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2ccb28-69f6-4734-a931-c4f2a7dedac3 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:23.881922 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2ccb28-69f6-4734-a931-c4f2a7dedac3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:23.882754 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2ccb28-69f6-4734-a931-c4f2a7dedac3 None admin] RBAC: Adding query filter params (group.id=88aff3277a984c00a5903432c1757a32, role.id=7441b1b1ab104537addd90a2471822f3, scope.project.id=dc58de68345f40498e25fd3ab4626f7f) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:04:23.883068 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2ccb28-69f6-4734-a931-c4f2a7dedac3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:23.884566 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2ccb28-69f6-4734-a931-c4f2a7dedac3 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:23.897641 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 173/361] 10.222.0.136 () {56 vars in 1381 bytes} [Thu Jul 14 17:04:23 2022] GET /identity/v3/role_assignments?group.id=88aff3277a984c00a5903432c1757a32&scope.project.id=dc58de68345f40498e25fd3ab4626f7f&role.id=7441b1b1ab104537addd90a2471822f3 => generated 261 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:04:23.898844 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2ccb28-69f6-4734-a931-c4f2a7dedac3 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:23.926431 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bde00d3-75d7-4faf-9d91-4615c6a8fa6c None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:23.976896 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc37ace1-5c99-4fc7-9233-d35c9d77737f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:23.978028 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc37ace1-5c99-4fc7-9233-d35c9d77737f None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:23.978514 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc37ace1-5c99-4fc7-9233-d35c9d77737f None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:23.979049 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc37ace1-5c99-4fc7-9233-d35c9d77737f None admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:23.980068 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc37ace1-5c99-4fc7-9233-d35c9d77737f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:04:23.980590 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc37ace1-5c99-4fc7-9233-d35c9d77737f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:23.982349 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc37ace1-5c99-4fc7-9233-d35c9d77737f None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:23.992484 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 189/362] 10.222.0.136 () {56 vars in 1116 bytes} [Thu Jul 14 17:04:23 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:04:23.993211 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc37ace1-5c99-4fc7-9233-d35c9d77737f None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:24.024811 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:24.025491 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:24.054004 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2ccb28-69f6-4734-a931-c4f2a7dedac3 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:24.099151 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bb4d46-22a2-40cd-8790-0b6b8a8c6784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:24.100249 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bb4d46-22a2-40cd-8790-0b6b8a8c6784 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:24.100602 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bb4d46-22a2-40cd-8790-0b6b8a8c6784 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:24.100856 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bb4d46-22a2-40cd-8790-0b6b8a8c6784 None admin] PATH_INFO: `/v3/groups/88aff3277a984c00a5903432c1757a32` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:24.107078 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bb4d46-22a2-40cd-8790-0b6b8a8c6784 None admin] RBAC: Authorizing `identity:get_group(group_id=88aff3277a984c00a5903432c1757a32)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:24.109033 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bb4d46-22a2-40cd-8790-0b6b8a8c6784 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:24.111141 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 174/363] 10.222.0.136 () {56 vars in 1185 bytes} [Thu Jul 14 17:04:23 2022] GET /identity/v3/groups/88aff3277a984c00a5903432c1757a32 => generated 227 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:04:24.112059 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bb4d46-22a2-40cd-8790-0b6b8a8c6784 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:24.144839 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc37ace1-5c99-4fc7-9233-d35c9d77737f None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:24.191131 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2f0ca2-927b-4838-a304-b7b28b35e0ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:24.195307 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2f0ca2-927b-4838-a304-b7b28b35e0ae None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:24.195307 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2f0ca2-927b-4838-a304-b7b28b35e0ae None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:24.195307 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2f0ca2-927b-4838-a304-b7b28b35e0ae None admin] PATH_INFO: `/v3/groups/88aff3277a984c00a5903432c1757a32` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:24.195307 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2f0ca2-927b-4838-a304-b7b28b35e0ae None admin] RBAC: Authorizing `identity:get_group(group_id=88aff3277a984c00a5903432c1757a32)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:24.196776 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2f0ca2-927b-4838-a304-b7b28b35e0ae None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:24.198929 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 190/364] 10.222.0.136 () {56 vars in 1185 bytes} [Thu Jul 14 17:04:23 2022] GET /identity/v3/groups/88aff3277a984c00a5903432c1757a32 => generated 227 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:04:24.202135 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b2621d-8a5e-48df-8d1e-364fb5fd2b24 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:24.202135 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b2621d-8a5e-48df-8d1e-364fb5fd2b24 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:24.202135 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b2621d-8a5e-48df-8d1e-364fb5fd2b24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:24.221890 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-c1b2621d-8a5e-48df-8d1e-364fb5fd2b24 None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:04:24.223196 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-c1b2621d-8a5e-48df-8d1e-364fb5fd2b24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:04:24.256972 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bb4d46-22a2-40cd-8790-0b6b8a8c6784 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:24.301050 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73924d7a-786a-40a7-bb40-d7de75f96144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:24.302679 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73924d7a-786a-40a7-bb40-d7de75f96144 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:24.302863 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73924d7a-786a-40a7-bb40-d7de75f96144 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:24.303120 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73924d7a-786a-40a7-bb40-d7de75f96144 None admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:24.304071 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73924d7a-786a-40a7-bb40-d7de75f96144 None admin] RBAC: Adding query filter params (name=reader) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:04:24.304386 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73924d7a-786a-40a7-bb40-d7de75f96144 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:24.305780 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73924d7a-786a-40a7-bb40-d7de75f96144 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:24.306995 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 191/365] 10.222.0.136 () {58 vars in 1028 bytes} [Thu Jul 14 17:04:24 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 17:04:24.308336 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b2621d-8a5e-48df-8d1e-364fb5fd2b24 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:24.320625 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 175/366] 10.222.0.136 () {56 vars in 1106 bytes} [Thu Jul 14 17:04:24 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:04:24.321484 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73924d7a-786a-40a7-bb40-d7de75f96144 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:24.339450 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:24.343903 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:24.428624 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b2621d-8a5e-48df-8d1e-364fb5fd2b24 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:24.445292 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73924d7a-786a-40a7-bb40-d7de75f96144 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:24.467416 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc82aa2b-e25c-4056-9bef-a9a20db28b05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:24.468489 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc82aa2b-e25c-4056-9bef-a9a20db28b05 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:24.468904 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc82aa2b-e25c-4056-9bef-a9a20db28b05 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:24.469206 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc82aa2b-e25c-4056-9bef-a9a20db28b05 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:24.484211 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d393d75f-e0a5-481a-ad84-6e6d9f0c3739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:24.485187 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d393d75f-e0a5-481a-ad84-6e6d9f0c3739 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:24.485654 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d393d75f-e0a5-481a-ad84-6e6d9f0c3739 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:24.486113 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d393d75f-e0a5-481a-ad84-6e6d9f0c3739 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:24.487113 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d393d75f-e0a5-481a-ad84-6e6d9f0c3739 None admin] RBAC: Adding query filter params (group.id=88aff3277a984c00a5903432c1757a32, role.id=5e321db416444dc9b5bfce7db763a7ed, scope.project.id=8bd70064655e4aa5832910aaa0dd0116) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:04:24.487580 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d393d75f-e0a5-481a-ad84-6e6d9f0c3739 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:24.489149 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d393d75f-e0a5-481a-ad84-6e6d9f0c3739 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:24.495842 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 176/367] 10.222.0.136 () {56 vars in 1381 bytes} [Thu Jul 14 17:04:24 2022] GET /identity/v3/role_assignments?group.id=88aff3277a984c00a5903432c1757a32&scope.project.id=8bd70064655e4aa5832910aaa0dd0116&role.id=5e321db416444dc9b5bfce7db763a7ed => generated 261 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:04:24.496879 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d393d75f-e0a5-481a-ad84-6e6d9f0c3739 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:24.570454 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc82aa2b-e25c-4056-9bef-a9a20db28b05 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:24.572622 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc82aa2b-e25c-4056-9bef-a9a20db28b05 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:24.598697 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:24.609963 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:24.644340 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d393d75f-e0a5-481a-ad84-6e6d9f0c3739 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:24.684179 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8fb726-087a-401c-85c5-ee43de82356a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:24.684854 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8fb726-087a-401c-85c5-ee43de82356a None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:24.685145 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8fb726-087a-401c-85c5-ee43de82356a None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:24.685430 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8fb726-087a-401c-85c5-ee43de82356a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:24.687164 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8fb726-087a-401c-85c5-ee43de82356a None admin] RBAC: Adding query filter params (group.id=88aff3277a984c00a5903432c1757a32, role.id=7441b1b1ab104537addd90a2471822f3, scope.project.id=8bd70064655e4aa5832910aaa0dd0116) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:04:24.687489 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8fb726-087a-401c-85c5-ee43de82356a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:24.688945 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8fb726-087a-401c-85c5-ee43de82356a None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:24.696049 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 177/368] 10.222.0.136 () {56 vars in 1381 bytes} [Thu Jul 14 17:04:24 2022] GET /identity/v3/role_assignments?group.id=88aff3277a984c00a5903432c1757a32&scope.project.id=8bd70064655e4aa5832910aaa0dd0116&role.id=7441b1b1ab104537addd90a2471822f3 => generated 261 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:04:24.697366 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8fb726-087a-401c-85c5-ee43de82356a None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:24.709578 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 192/369] 10.222.0.136 () {58 vars in 1287 bytes} [Thu Jul 14 17:04:24 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 17:04:24.709578 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc82aa2b-e25c-4056-9bef-a9a20db28b05 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:24.837009 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8fb726-087a-401c-85c5-ee43de82356a None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:24.855829 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc82aa2b-e25c-4056-9bef-a9a20db28b05 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:24.883018 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:24.904728 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9607f38-6985-4ce9-aedb-ccebc48a5669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:24.905822 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9607f38-6985-4ce9-aedb-ccebc48a5669 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:24.909846 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9607f38-6985-4ce9-aedb-ccebc48a5669 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:24.910328 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9607f38-6985-4ce9-aedb-ccebc48a5669 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:24.935529 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9607f38-6985-4ce9-aedb-ccebc48a5669 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 17:04:24.941005 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f1cb8e-493c-482e-81e3-18052f0021cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:24.941966 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f1cb8e-493c-482e-81e3-18052f0021cb None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:24.942255 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f1cb8e-493c-482e-81e3-18052f0021cb None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:24.947190 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f1cb8e-493c-482e-81e3-18052f0021cb None admin] PATH_INFO: `/v3/users/f9c8aae316ae458c8fcecc741a32ca77` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:24.948211 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-f9607f38-6985-4ce9-aedb-ccebc48a5669 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 17:04:24.948211 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:04:24.948211 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:04:24.948211 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:04:24.948211 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:04:24.948211 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:04:24.948211 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:04:24.948211 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:04:24.948211 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:04:24.948211 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:04:24.948211 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:04:24.948211 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:04:24.948211 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 17:04:24.948211 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 17:04:24.948211 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 17:04:24.948211 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 17:04:24.949074 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 17:04:24.949074 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 17:04:24.949074 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 17:04:24.949074 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 17:04:24.949074 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:04:24.949074 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:04:24.949074 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:04:24.949074 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:04:24.949074 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:04:24.949074 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:04:24.949074 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:04:24.949074 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Jul 14 17:04:24.949074 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:04:24.949074 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:04:24.949074 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:04:24.949074 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:04:24.949898 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:04:24.949898 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:04:24.949898 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:04:24.949898 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:04:24.949898 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 17:04:24.949898 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 17:04:24.949898 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 17:04:24.949898 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 17:04:24.949898 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 17:04:24.949898 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 17:04:24.949898 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 17:04:24.949898 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Jul 14 17:04:24.950517 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f1cb8e-493c-482e-81e3-18052f0021cb None admin] RBAC: Authorizing `identity:get_user(user_id=f9c8aae316ae458c8fcecc741a32ca77)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:24.950517 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f1cb8e-493c-482e-81e3-18052f0021cb None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:24.952400 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 178/370] 10.222.0.136 () {56 vars in 1182 bytes} [Thu Jul 14 17:04:24 2022] GET /identity/v3/users/f9c8aae316ae458c8fcecc741a32ca77 => generated 294 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:04:24.953185 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f1cb8e-493c-482e-81e3-18052f0021cb None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:24.957853 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 193/371] 10.222.0.136 () {56 vars in 1101 bytes} [Thu Jul 14 17:04:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:04:24.959902 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9607f38-6985-4ce9-aedb-ccebc48a5669 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:24.964525 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:25.077930 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f1cb8e-493c-482e-81e3-18052f0021cb None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:25.128057 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192b9204-0daa-4da8-8927-7576b9aee370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:25.129314 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192b9204-0daa-4da8-8927-7576b9aee370 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:25.129827 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192b9204-0daa-4da8-8927-7576b9aee370 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:25.130377 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192b9204-0daa-4da8-8927-7576b9aee370 None admin] PATH_INFO: `/v3/projects/dc58de68345f40498e25fd3ab4626f7f` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:25.133711 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192b9204-0daa-4da8-8927-7576b9aee370 None admin] RBAC: Authorizing `identity:get_project(project_id=dc58de68345f40498e25fd3ab4626f7f)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:25.135419 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192b9204-0daa-4da8-8927-7576b9aee370 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:25.139566 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 179/372] 10.222.0.136 () {56 vars in 1191 bytes} [Thu Jul 14 17:04:24 2022] GET /identity/v3/projects/dc58de68345f40498e25fd3ab4626f7f => generated 303 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:04:25.143115 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192b9204-0daa-4da8-8927-7576b9aee370 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:25.175897 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9607f38-6985-4ce9-aedb-ccebc48a5669 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:25.265933 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:25.267246 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc8904d-3cc5-459e-9951-55708621edca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:25.267998 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc8904d-3cc5-459e-9951-55708621edca None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:25.268306 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc8904d-3cc5-459e-9951-55708621edca None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:25.268630 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc8904d-3cc5-459e-9951-55708621edca None admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:25.269442 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc8904d-3cc5-459e-9951-55708621edca None admin] RBAC: Adding query filter params (name=admin) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:04:25.274761 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc8904d-3cc5-459e-9951-55708621edca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:25.276188 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc8904d-3cc5-459e-9951-55708621edca None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:25.296163 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 194/373] 10.222.0.136 () {56 vars in 1104 bytes} [Thu Jul 14 17:04:24 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:04:25.297123 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc8904d-3cc5-459e-9951-55708621edca None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:25.341492 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192b9204-0daa-4da8-8927-7576b9aee370 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:25.381877 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ba6fd6-11a3-467c-8fc8-9b136b3b794f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:25.382558 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ba6fd6-11a3-467c-8fc8-9b136b3b794f None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:25.382846 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ba6fd6-11a3-467c-8fc8-9b136b3b794f None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:25.383129 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ba6fd6-11a3-467c-8fc8-9b136b3b794f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:25.384780 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ba6fd6-11a3-467c-8fc8-9b136b3b794f None admin] RBAC: Adding query filter params (role.id=2df0ddb31c5141c496d5705ff0dd2bc0, user.id=f9c8aae316ae458c8fcecc741a32ca77, scope.system=all) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:04:25.385106 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ba6fd6-11a3-467c-8fc8-9b136b3b794f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:25.386601 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ba6fd6-11a3-467c-8fc8-9b136b3b794f None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:25.400381 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:25.419417 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 180/374] 10.222.0.136 () {56 vars in 1313 bytes} [Thu Jul 14 17:04:25 2022] GET /identity/v3/role_assignments?user.id=f9c8aae316ae458c8fcecc741a32ca77&scope.system=all&role.id=2df0ddb31c5141c496d5705ff0dd2bc0 => generated 512 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:04:25.420397 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ba6fd6-11a3-467c-8fc8-9b136b3b794f None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:25.557916 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc8904d-3cc5-459e-9951-55708621edca None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:25.616847 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ba6fd6-11a3-467c-8fc8-9b136b3b794f None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:25.645427 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d36c67-bced-4b45-90e9-ee5c6a49a57b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:25.647263 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d36c67-bced-4b45-90e9-ee5c6a49a57b None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:25.647844 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d36c67-bced-4b45-90e9-ee5c6a49a57b None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:25.648403 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d36c67-bced-4b45-90e9-ee5c6a49a57b None admin] PATH_INFO: `/v3/groups/88aff3277a984c00a5903432c1757a32` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:25.653859 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d36c67-bced-4b45-90e9-ee5c6a49a57b None admin] RBAC: Authorizing `identity:get_group(group_id=88aff3277a984c00a5903432c1757a32)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:25.654179 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:25.655323 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d36c67-bced-4b45-90e9-ee5c6a49a57b None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:25.658625 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 195/375] 10.222.0.136 () {56 vars in 1185 bytes} [Thu Jul 14 17:04:25 2022] GET /identity/v3/groups/88aff3277a984c00a5903432c1757a32 => generated 227 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:04:25.664182 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d36c67-bced-4b45-90e9-ee5c6a49a57b None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:25.666117 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272ef765-3391-41bd-b1a2-de10caf1a92c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:25.666826 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272ef765-3391-41bd-b1a2-de10caf1a92c None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:25.667098 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272ef765-3391-41bd-b1a2-de10caf1a92c None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:25.667384 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272ef765-3391-41bd-b1a2-de10caf1a92c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:25.845224 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272ef765-3391-41bd-b1a2-de10caf1a92c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:25.846657 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272ef765-3391-41bd-b1a2-de10caf1a92c None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:25.903472 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d36c67-bced-4b45-90e9-ee5c6a49a57b None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:25.920046 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:25.975166 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cfc24f-cb16-44bb-a405-e740252fe788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:25.975837 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cfc24f-cb16-44bb-a405-e740252fe788 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:25.976124 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cfc24f-cb16-44bb-a405-e740252fe788 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:25.976406 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cfc24f-cb16-44bb-a405-e740252fe788 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:25.977245 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cfc24f-cb16-44bb-a405-e740252fe788 None admin] RBAC: Adding query filter params (group.id=88aff3277a984c00a5903432c1757a32, role.id=5e321db416444dc9b5bfce7db763a7ed, scope.project.id=dc58de68345f40498e25fd3ab4626f7f) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:04:25.977586 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cfc24f-cb16-44bb-a405-e740252fe788 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:25.979029 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cfc24f-cb16-44bb-a405-e740252fe788 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:25.984906 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 181/376] 10.222.0.136 () {58 vars in 1287 bytes} [Thu Jul 14 17:04:25 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 565 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 17:04:25.990193 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 196/377] 10.222.0.136 () {56 vars in 1381 bytes} [Thu Jul 14 17:04:25 2022] GET /identity/v3/role_assignments?group.id=88aff3277a984c00a5903432c1757a32&scope.project.id=dc58de68345f40498e25fd3ab4626f7f&role.id=5e321db416444dc9b5bfce7db763a7ed => generated 261 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:04:25.991938 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272ef765-3391-41bd-b1a2-de10caf1a92c None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:26.048912 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:26.157874 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272ef765-3391-41bd-b1a2-de10caf1a92c None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:26.214309 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392761c8-c062-4a17-83f1-3bea2eac4181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:26.215195 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392761c8-c062-4a17-83f1-3bea2eac4181 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:26.215480 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392761c8-c062-4a17-83f1-3bea2eac4181 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:26.215758 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392761c8-c062-4a17-83f1-3bea2eac4181 None admin] PATH_INFO: `/v3/projects/602fa21468b24207a8f98e92cd2c99ce` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:26.222550 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392761c8-c062-4a17-83f1-3bea2eac4181 None admin] RBAC: Authorizing `identity:get_project(project_id=602fa21468b24207a8f98e92cd2c99ce)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:26.224582 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392761c8-c062-4a17-83f1-3bea2eac4181 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:26.226580 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 182/378] 10.222.0.136 () {56 vars in 1191 bytes} [Thu Jul 14 17:04:25 2022] GET /identity/v3/projects/602fa21468b24207a8f98e92cd2c99ce => generated 345 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:04:26.232652 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cfc24f-cb16-44bb-a405-e740252fe788 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:26.366491 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cfc24f-cb16-44bb-a405-e740252fe788 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:26.397442 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231916b1-5b96-4705-9197-f3cc5f303701 None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:26.398443 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231916b1-5b96-4705-9197-f3cc5f303701 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:26.398924 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231916b1-5b96-4705-9197-f3cc5f303701 None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:26.405576 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4949191-81a5-4bcd-8501-849d0e10691a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:26.405576 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4949191-81a5-4bcd-8501-849d0e10691a None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:26.405576 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4949191-81a5-4bcd-8501-849d0e10691a None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:26.405576 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4949191-81a5-4bcd-8501-849d0e10691a None admin] PATH_INFO: `/v3/groups/dc48be0421c84e64b849cbd6e2cadae0` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:26.406127 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 183/379] 10.222.0.136 () {54 vars in 931 bytes} [Thu Jul 14 17:04:26 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:04:26.409714 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4949191-81a5-4bcd-8501-849d0e10691a None admin] RBAC: Authorizing `identity:get_group(group_id=dc48be0421c84e64b849cbd6e2cadae0)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:26.410915 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4949191-81a5-4bcd-8501-849d0e10691a None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:26.411996 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3096eb-673c-470f-b259-38e197fa87ca None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:26.412493 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3096eb-673c-470f-b259-38e197fa87ca None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:26.412900 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 197/380] 10.222.0.136 () {56 vars in 1185 bytes} [Thu Jul 14 17:04:26 2022] GET /identity/v3/groups/dc48be0421c84e64b849cbd6e2cadae0 => generated 230 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:04:26.413267 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3096eb-673c-470f-b259-38e197fa87ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:26.418470 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4949191-81a5-4bcd-8501-849d0e10691a None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:26.457091 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-0e3096eb-673c-470f-b259-38e197fa87ca None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:04:26.459509 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-0e3096eb-673c-470f-b259-38e197fa87ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:04:26.462222 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:26.528146 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4949191-81a5-4bcd-8501-849d0e10691a None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:26.578852 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d4e699-be70-4a8a-8418-e0a015d8dbe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:26.579513 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d4e699-be70-4a8a-8418-e0a015d8dbe1 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:26.579795 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d4e699-be70-4a8a-8418-e0a015d8dbe1 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:26.580069 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d4e699-be70-4a8a-8418-e0a015d8dbe1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:26.580896 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d4e699-be70-4a8a-8418-e0a015d8dbe1 None admin] RBAC: Adding query filter params (group.id=dc48be0421c84e64b849cbd6e2cadae0, role.id=284c6314b4d3492085e397a87b0e3b51, scope.project.id=602fa21468b24207a8f98e92cd2c99ce) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:04:26.581204 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d4e699-be70-4a8a-8418-e0a015d8dbe1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:26.582669 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d4e699-be70-4a8a-8418-e0a015d8dbe1 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:26.592351 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 198/381] 10.222.0.136 () {56 vars in 1381 bytes} [Thu Jul 14 17:04:26 2022] GET /identity/v3/role_assignments?group.id=dc48be0421c84e64b849cbd6e2cadae0&scope.project.id=602fa21468b24207a8f98e92cd2c99ce&role.id=284c6314b4d3492085e397a87b0e3b51 => generated 261 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 17:04:26.625025 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 184/382] 10.222.0.136 () {58 vars in 1028 bytes} [Thu Jul 14 17:04:26 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 17:04:26.663300 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d4e699-be70-4a8a-8418-e0a015d8dbe1 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:26.790309 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d4e699-be70-4a8a-8418-e0a015d8dbe1 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:26.791898 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:26.831207 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb30a2e-9175-4bf7-a801-88fdf08364f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:26.832018 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb30a2e-9175-4bf7-a801-88fdf08364f6 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:26.832302 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb30a2e-9175-4bf7-a801-88fdf08364f6 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:26.832573 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb30a2e-9175-4bf7-a801-88fdf08364f6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:26.845203 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb30a2e-9175-4bf7-a801-88fdf08364f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 17:04:26.857348 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-5cb30a2e-9175-4bf7-a801-88fdf08364f6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 17:04:26.857348 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:04:26.857348 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:04:26.857348 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:04:26.857348 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:04:26.857348 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:04:26.857348 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:04:26.857348 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:04:26.857348 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:04:26.857348 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:04:26.857348 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:04:26.857348 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:04:26.857348 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 17:04:26.857348 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 17:04:26.857348 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 17:04:26.857348 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 17:04:26.858349 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 17:04:26.858349 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 17:04:26.858349 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 17:04:26.858349 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 17:04:26.858349 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:04:26.858349 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:04:26.858349 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:04:26.858349 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:04:26.858349 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:04:26.858349 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:04:26.858349 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:04:26.858349 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Jul 14 17:04:26.858349 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:04:26.858349 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:04:26.858349 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:04:26.858349 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:04:26.859138 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:04:26.859138 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:04:26.859138 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:04:26.859138 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:04:26.859138 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 17:04:26.859138 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 17:04:26.859138 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 17:04:26.859138 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 17:04:26.859138 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 17:04:26.859138 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 17:04:26.859138 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 17:04:26.859138 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Jul 14 17:04:26.859138 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 199/383] 10.222.0.136 () {56 vars in 1104 bytes} [Thu Jul 14 17:04:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:04:26.865168 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3096eb-673c-470f-b259-38e197fa87ca None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:26.910547 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:27.016110 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3096eb-673c-470f-b259-38e197fa87ca None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:27.060671 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bb5807-4ce5-461c-b44f-f70ffd5bb581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:27.061363 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bb5807-4ce5-461c-b44f-f70ffd5bb581 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:27.061671 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bb5807-4ce5-461c-b44f-f70ffd5bb581 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:27.061950 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bb5807-4ce5-461c-b44f-f70ffd5bb581 None admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:27.062709 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bb5807-4ce5-461c-b44f-f70ffd5bb581 None admin] RBAC: Adding query filter params (name=member) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:04:27.063013 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bb5807-4ce5-461c-b44f-f70ffd5bb581 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:27.064388 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bb5807-4ce5-461c-b44f-f70ffd5bb581 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:27.074674 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 185/384] 10.222.0.136 () {56 vars in 1106 bytes} [Thu Jul 14 17:04:26 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 17:04:27.080329 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb30a2e-9175-4bf7-a801-88fdf08364f6 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:27.246423 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb30a2e-9175-4bf7-a801-88fdf08364f6 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:27.294709 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dbf89d-158d-43c8-9fed-d1d823624620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:27.295798 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dbf89d-158d-43c8-9fed-d1d823624620 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:27.296084 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dbf89d-158d-43c8-9fed-d1d823624620 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:27.296367 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dbf89d-158d-43c8-9fed-d1d823624620 None admin] PATH_INFO: `/v3/groups/88aff3277a984c00a5903432c1757a32` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:27.297865 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dbf89d-158d-43c8-9fed-d1d823624620 None admin] RBAC: Authorizing `identity:get_group(group_id=88aff3277a984c00a5903432c1757a32)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:27.300264 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dbf89d-158d-43c8-9fed-d1d823624620 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:27.302647 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 200/385] 10.222.0.136 () {56 vars in 1185 bytes} [Thu Jul 14 17:04:27 2022] GET /identity/v3/groups/88aff3277a984c00a5903432c1757a32 => generated 227 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:04:27.308226 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bb5807-4ce5-461c-b44f-f70ffd5bb581 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:27.446218 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ce7ec2-5137-4a36-8058-8ac1c1cd7cbe None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:27.446793 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ce7ec2-5137-4a36-8058-8ac1c1cd7cbe None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:27.447251 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ce7ec2-5137-4a36-8058-8ac1c1cd7cbe None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:27.449007 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 201/386] 10.222.0.136 () {54 vars in 931 bytes} [Thu Jul 14 17:04:27 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:04:27.454344 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fe9d6d-c04a-4780-8e0a-d3e44d86b0ed None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:27.454836 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fe9d6d-c04a-4780-8e0a-d3e44d86b0ed None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:27.455296 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fe9d6d-c04a-4780-8e0a-d3e44d86b0ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:27.473988 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-24fe9d6d-c04a-4780-8e0a-d3e44d86b0ed None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:04:27.475734 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-24fe9d6d-c04a-4780-8e0a-d3e44d86b0ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:04:27.495512 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:27.515136 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:27.520946 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bb5807-4ce5-461c-b44f-f70ffd5bb581 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:27.578835 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3846e444-dd1a-4aef-8855-d8ef06f8037f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:27.580515 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3846e444-dd1a-4aef-8855-d8ef06f8037f None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:27.581105 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3846e444-dd1a-4aef-8855-d8ef06f8037f None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:27.581596 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3846e444-dd1a-4aef-8855-d8ef06f8037f None admin] PATH_INFO: `/v3/projects/dc58de68345f40498e25fd3ab4626f7f` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:27.584208 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3846e444-dd1a-4aef-8855-d8ef06f8037f None admin] RBAC: Authorizing `identity:get_project(project_id=dc58de68345f40498e25fd3ab4626f7f)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:27.585899 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3846e444-dd1a-4aef-8855-d8ef06f8037f None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:27.587792 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 202/387] 10.222.0.136 () {58 vars in 1028 bytes} [Thu Jul 14 17:04:27 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 17:04:27.593588 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca32e46-de7e-437c-9212-4bd13ca0634d None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:27.593588 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca32e46-de7e-437c-9212-4bd13ca0634d None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:27.593588 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca32e46-de7e-437c-9212-4bd13ca0634d None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:27.594517 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 186/389] 10.222.0.136 () {56 vars in 1191 bytes} [Thu Jul 14 17:04:27 2022] GET /identity/v3/projects/dc58de68345f40498e25fd3ab4626f7f => generated 303 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:04:27.594630 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 203/389] 10.222.0.136 () {54 vars in 931 bytes} [Thu Jul 14 17:04:27 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:04:27.597576 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca32e46-de7e-437c-9212-4bd13ca0634d None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:27.606659 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d15687-7467-4e9b-8791-bb9b72c0b63e None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:27.607215 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d15687-7467-4e9b-8791-bb9b72c0b63e None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:27.607694 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d15687-7467-4e9b-8791-bb9b72c0b63e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:27.635580 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-75d15687-7467-4e9b-8791-bb9b72c0b63e None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:04:27.636776 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-75d15687-7467-4e9b-8791-bb9b72c0b63e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:04:27.745715 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 187/390] 10.222.0.136 () {58 vars in 1028 bytes} [Thu Jul 14 17:04:27 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 17:04:27.747061 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d15687-7467-4e9b-8791-bb9b72c0b63e None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:27.774419 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca32e46-de7e-437c-9212-4bd13ca0634d None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:27.811086 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6451c39b-1e62-49e4-bd23-1906b5b9f97d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:27.812352 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6451c39b-1e62-49e4-bd23-1906b5b9f97d None admin] REQUEST_METHOD: `PUT` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:27.812931 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6451c39b-1e62-49e4-bd23-1906b5b9f97d None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:27.813433 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6451c39b-1e62-49e4-bd23-1906b5b9f97d None admin] PATH_INFO: `/v3/projects/dc58de68345f40498e25fd3ab4626f7f/groups/88aff3277a984c00a5903432c1757a32/roles/7441b1b1ab104537addd90a2471822f3` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:27.815662 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6451c39b-1e62-49e4-bd23-1906b5b9f97d None admin] RBAC: Authorizing `identity:create_grant(project_id=dc58de68345f40498e25fd3ab4626f7f, group_id=88aff3277a984c00a5903432c1757a32, role_id=7441b1b1ab104537addd90a2471822f3)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:27.817835 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6451c39b-1e62-49e4-bd23-1906b5b9f97d None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:27.837485 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 204/391] 10.222.0.136 () {58 vars in 1447 bytes} [Thu Jul 14 17:04:27 2022] PUT /identity/v3/projects/dc58de68345f40498e25fd3ab4626f7f/groups/88aff3277a984c00a5903432c1757a32/roles/7441b1b1ab104537addd90a2471822f3 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:04:27.845592 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6451c39b-1e62-49e4-bd23-1906b5b9f97d None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:27.869026 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:27.884217 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:27.885404 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d15687-7467-4e9b-8791-bb9b72c0b63e None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:27.931579 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8434627-13d1-415a-a33a-8d73897ea993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:27.931579 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8434627-13d1-415a-a33a-8d73897ea993 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:27.931579 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8434627-13d1-415a-a33a-8d73897ea993 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:27.931579 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8434627-13d1-415a-a33a-8d73897ea993 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:27.944665 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8434627-13d1-415a-a33a-8d73897ea993 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 17:04:27.954001 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-d8434627-13d1-415a-a33a-8d73897ea993 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 17:04:27.954001 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:04:27.954001 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:04:27.954001 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:04:27.954001 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:04:27.954001 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:04:27.954001 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:04:27.954001 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:04:27.954001 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:04:27.954001 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:04:27.954001 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:04:27.954001 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:04:27.954001 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 17:04:27.954001 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 17:04:27.954001 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 17:04:27.954001 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 17:04:27.954989 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 17:04:27.954989 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 17:04:27.954989 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 17:04:27.954989 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 17:04:27.954989 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:04:27.954989 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:04:27.954989 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:04:27.954989 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:04:27.954989 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:04:27.954989 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:04:27.954989 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:04:27.954989 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Jul 14 17:04:27.954989 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:04:27.954989 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:04:27.954989 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:04:27.954989 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:04:27.955778 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:04:27.955778 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:04:27.955778 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:04:27.955778 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:04:27.955778 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 17:04:27.955778 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 17:04:27.955778 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 17:04:27.955778 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 17:04:27.955778 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 17:04:27.955778 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 17:04:27.955778 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 17:04:27.955778 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Jul 14 17:04:27.955778 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 188/392] 10.222.0.136 () {56 vars in 1119 bytes} [Thu Jul 14 17:04:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:04:27.964763 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8434627-13d1-415a-a33a-8d73897ea993 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:28.065510 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6451c39b-1e62-49e4-bd23-1906b5b9f97d None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:28.123029 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d5285a-d222-4517-90bc-1d61cdcca659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:28.124199 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d5285a-d222-4517-90bc-1d61cdcca659 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:28.124681 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d5285a-d222-4517-90bc-1d61cdcca659 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:28.125164 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d5285a-d222-4517-90bc-1d61cdcca659 None admin] PATH_INFO: `/v3/roles/member` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:28.132081 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8434627-13d1-415a-a33a-8d73897ea993 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:28.137072 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d5285a-d222-4517-90bc-1d61cdcca659 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 17:04:28.145107 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-96d5285a-d222-4517-90bc-1d61cdcca659 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 17:04:28.145107 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:04:28.145107 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:04:28.145107 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:04:28.145107 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:04:28.145107 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:04:28.145107 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:04:28.145107 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:04:28.145107 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:04:28.145107 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:04:28.145107 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:04:28.145107 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:04:28.145107 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 17:04:28.145107 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 17:04:28.145107 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 17:04:28.145107 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 17:04:28.146649 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 17:04:28.146649 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 17:04:28.146649 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 17:04:28.146649 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 17:04:28.146649 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:04:28.146649 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:04:28.146649 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:04:28.146649 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:04:28.146649 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:04:28.146649 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:04:28.146649 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:04:28.146649 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Jul 14 17:04:28.146649 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:04:28.146649 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:04:28.146649 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:04:28.146649 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:04:28.147457 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:04:28.147457 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:04:28.147457 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:04:28.147457 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:04:28.147457 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 17:04:28.147457 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 17:04:28.147457 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 17:04:28.147457 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 17:04:28.147457 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 17:04:28.147457 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 17:04:28.147457 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 17:04:28.147457 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Jul 14 17:04:28.150625 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 205/393] 10.222.0.136 () {56 vars in 1104 bytes} [Thu Jul 14 17:04:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:04:28.156021 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d5285a-d222-4517-90bc-1d61cdcca659 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:28.184691 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac1dfce-9cea-439c-bc2c-1af504752de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:28.186529 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac1dfce-9cea-439c-bc2c-1af504752de3 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:28.187056 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac1dfce-9cea-439c-bc2c-1af504752de3 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:28.187838 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac1dfce-9cea-439c-bc2c-1af504752de3 None admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:28.189106 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac1dfce-9cea-439c-bc2c-1af504752de3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:04:28.189674 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac1dfce-9cea-439c-bc2c-1af504752de3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:28.198092 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac1dfce-9cea-439c-bc2c-1af504752de3 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:28.214580 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 189/394] 10.222.0.136 () {56 vars in 1116 bytes} [Thu Jul 14 17:04:27 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 17:04:28.219996 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac1dfce-9cea-439c-bc2c-1af504752de3 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:28.249910 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:28.325902 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:28.355074 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d5285a-d222-4517-90bc-1d61cdcca659 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:28.388704 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac1dfce-9cea-439c-bc2c-1af504752de3 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:28.423797 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acd5d34-e004-4044-8d4e-33a2e611901d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:28.424780 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acd5d34-e004-4044-8d4e-33a2e611901d None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:28.425153 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acd5d34-e004-4044-8d4e-33a2e611901d None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:28.425442 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acd5d34-e004-4044-8d4e-33a2e611901d None admin] PATH_INFO: `/v3/groups/88aff3277a984c00a5903432c1757a32` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:28.426817 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acd5d34-e004-4044-8d4e-33a2e611901d None admin] RBAC: Authorizing `identity:get_group(group_id=88aff3277a984c00a5903432c1757a32)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:28.427679 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7673620b-1ce9-4a9f-825f-0b89f6eca419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:28.428273 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acd5d34-e004-4044-8d4e-33a2e611901d None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:28.428676 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7673620b-1ce9-4a9f-825f-0b89f6eca419 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:28.429098 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7673620b-1ce9-4a9f-825f-0b89f6eca419 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:28.429529 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7673620b-1ce9-4a9f-825f-0b89f6eca419 None admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:28.430331 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 190/395] 10.222.0.136 () {56 vars in 1185 bytes} [Thu Jul 14 17:04:28 2022] GET /identity/v3/groups/88aff3277a984c00a5903432c1757a32 => generated 227 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:04:28.430607 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7673620b-1ce9-4a9f-825f-0b89f6eca419 None admin] RBAC: Adding query filter params (name=member) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:04:28.430919 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7673620b-1ce9-4a9f-825f-0b89f6eca419 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:28.432275 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7673620b-1ce9-4a9f-825f-0b89f6eca419 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:28.440810 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acd5d34-e004-4044-8d4e-33a2e611901d None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:28.441386 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 206/396] 10.222.0.136 () {56 vars in 1106 bytes} [Thu Jul 14 17:04:28 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 17:04:28.458442 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7673620b-1ce9-4a9f-825f-0b89f6eca419 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:28.574575 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:28.599811 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acd5d34-e004-4044-8d4e-33a2e611901d None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:28.612084 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7673620b-1ce9-4a9f-825f-0b89f6eca419 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:28.661531 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5b3a1a-889d-45a7-9dd1-9401b1af1140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:28.662314 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5b3a1a-889d-45a7-9dd1-9401b1af1140 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:28.662601 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5b3a1a-889d-45a7-9dd1-9401b1af1140 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:28.662900 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5b3a1a-889d-45a7-9dd1-9401b1af1140 None admin] PATH_INFO: `/v3/groups/88aff3277a984c00a5903432c1757a32` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:28.664801 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5b3a1a-889d-45a7-9dd1-9401b1af1140 None admin] RBAC: Authorizing `identity:get_group(group_id=88aff3277a984c00a5903432c1757a32)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:28.666274 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5b3a1a-889d-45a7-9dd1-9401b1af1140 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:28.667914 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 207/397] 10.222.0.136 () {56 vars in 1185 bytes} [Thu Jul 14 17:04:28 2022] GET /identity/v3/groups/88aff3277a984c00a5903432c1757a32 => generated 227 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 17:04:28.678664 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5b3a1a-889d-45a7-9dd1-9401b1af1140 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:28.684208 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc3b576-f371-4104-8a1b-5fd775827d27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:28.685082 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc3b576-f371-4104-8a1b-5fd775827d27 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:28.685365 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc3b576-f371-4104-8a1b-5fd775827d27 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:28.685666 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc3b576-f371-4104-8a1b-5fd775827d27 None admin] PATH_INFO: `/v3/projects/8bd70064655e4aa5832910aaa0dd0116` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:28.688470 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc3b576-f371-4104-8a1b-5fd775827d27 None admin] RBAC: Authorizing `identity:get_project(project_id=8bd70064655e4aa5832910aaa0dd0116)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:28.689957 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc3b576-f371-4104-8a1b-5fd775827d27 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:28.701888 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 191/398] 10.222.0.136 () {56 vars in 1191 bytes} [Thu Jul 14 17:04:28 2022] GET /identity/v3/projects/8bd70064655e4aa5832910aaa0dd0116 => generated 299 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:04:28.703183 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc3b576-f371-4104-8a1b-5fd775827d27 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:28.718292 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:28.857463 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5b3a1a-889d-45a7-9dd1-9401b1af1140 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:28.905021 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d69b57-29c8-4060-9c23-ec4f69a3d0eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:28.905926 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d69b57-29c8-4060-9c23-ec4f69a3d0eb None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:28.906213 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d69b57-29c8-4060-9c23-ec4f69a3d0eb None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:28.906492 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d69b57-29c8-4060-9c23-ec4f69a3d0eb None admin] PATH_INFO: `/v3/projects/8bd70064655e4aa5832910aaa0dd0116` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:28.907802 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d69b57-29c8-4060-9c23-ec4f69a3d0eb None admin] RBAC: Authorizing `identity:get_project(project_id=8bd70064655e4aa5832910aaa0dd0116)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:28.909240 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d69b57-29c8-4060-9c23-ec4f69a3d0eb None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:28.913496 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 208/399] 10.222.0.136 () {56 vars in 1191 bytes} [Thu Jul 14 17:04:28 2022] GET /identity/v3/projects/8bd70064655e4aa5832910aaa0dd0116 => generated 299 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:04:28.920847 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d69b57-29c8-4060-9c23-ec4f69a3d0eb None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:28.963151 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc3b576-f371-4104-8a1b-5fd775827d27 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:29.034243 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925f4511-6621-4d8e-82ac-13145cd40cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:29.034892 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:29.037031 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925f4511-6621-4d8e-82ac-13145cd40cb8 None admin] REQUEST_METHOD: `PUT` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:29.037846 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925f4511-6621-4d8e-82ac-13145cd40cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:29.038396 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925f4511-6621-4d8e-82ac-13145cd40cb8 None admin] PATH_INFO: `/v3/projects/8bd70064655e4aa5832910aaa0dd0116/groups/88aff3277a984c00a5903432c1757a32/roles/5e321db416444dc9b5bfce7db763a7ed` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:29.040965 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925f4511-6621-4d8e-82ac-13145cd40cb8 None admin] RBAC: Authorizing `identity:create_grant(project_id=8bd70064655e4aa5832910aaa0dd0116, group_id=88aff3277a984c00a5903432c1757a32, role_id=5e321db416444dc9b5bfce7db763a7ed)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:29.042638 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925f4511-6621-4d8e-82ac-13145cd40cb8 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:29.060068 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d69b57-29c8-4060-9c23-ec4f69a3d0eb None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:29.062081 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 192/400] 10.222.0.136 () {58 vars in 1447 bytes} [Thu Jul 14 17:04:28 2022] PUT /identity/v3/projects/8bd70064655e4aa5832910aaa0dd0116/groups/88aff3277a984c00a5903432c1757a32/roles/5e321db416444dc9b5bfce7db763a7ed => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:04:29.064710 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc0dcec-1366-42e5-be13-fbed0d083d65 None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:29.065379 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc0dcec-1366-42e5-be13-fbed0d083d65 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:29.065890 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc0dcec-1366-42e5-be13-fbed0d083d65 None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:29.073096 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 193/401] 10.222.0.136 () {54 vars in 931 bytes} [Thu Jul 14 17:04:29 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:04:29.075920 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f70e863-eebd-49e1-a7de-f85ed7ee308d None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:29.076441 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f70e863-eebd-49e1-a7de-f85ed7ee308d None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:29.076952 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f70e863-eebd-49e1-a7de-f85ed7ee308d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:29.091898 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:29.102752 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-2f70e863-eebd-49e1-a7de-f85ed7ee308d None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:04:29.104435 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-2f70e863-eebd-49e1-a7de-f85ed7ee308d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:04:29.179162 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434cbf65-62ea-480c-8515-e709a5ab6465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:29.179992 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434cbf65-62ea-480c-8515-e709a5ab6465 None admin] REQUEST_METHOD: `PUT` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:29.180283 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434cbf65-62ea-480c-8515-e709a5ab6465 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:29.180678 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434cbf65-62ea-480c-8515-e709a5ab6465 None admin] PATH_INFO: `/v3/projects/8bd70064655e4aa5832910aaa0dd0116/groups/88aff3277a984c00a5903432c1757a32/roles/7441b1b1ab104537addd90a2471822f3` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:29.187051 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434cbf65-62ea-480c-8515-e709a5ab6465 None admin] RBAC: Authorizing `identity:create_grant(project_id=8bd70064655e4aa5832910aaa0dd0116, group_id=88aff3277a984c00a5903432c1757a32, role_id=7441b1b1ab104537addd90a2471822f3)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:29.188511 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434cbf65-62ea-480c-8515-e709a5ab6465 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:29.200440 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 194/402] 10.222.0.136 () {58 vars in 1028 bytes} [Thu Jul 14 17:04:29 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 17:04:29.225515 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f70e863-eebd-49e1-a7de-f85ed7ee308d None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:29.257957 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 209/403] 10.222.0.136 () {58 vars in 1447 bytes} [Thu Jul 14 17:04:28 2022] PUT /identity/v3/projects/8bd70064655e4aa5832910aaa0dd0116/groups/88aff3277a984c00a5903432c1757a32/roles/7441b1b1ab104537addd90a2471822f3 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:04:29.360675 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f70e863-eebd-49e1-a7de-f85ed7ee308d None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:29.401740 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335db04a-81e1-42b5-a982-eac789db9217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:29.403050 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335db04a-81e1-42b5-a982-eac789db9217 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:29.403430 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335db04a-81e1-42b5-a982-eac789db9217 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:29.403804 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335db04a-81e1-42b5-a982-eac789db9217 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:29.403896 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c9e0d1-daf6-4d12-b20c-fac7abcfd8ed None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:29.404339 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c9e0d1-daf6-4d12-b20c-fac7abcfd8ed None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:29.404435 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c9e0d1-daf6-4d12-b20c-fac7abcfd8ed None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:29.406019 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 210/404] 10.222.0.136 () {54 vars in 931 bytes} [Thu Jul 14 17:04:29 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:04:29.407576 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:29.412078 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ead6cc-8c64-434d-921c-d0802dd75d89 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:29.412643 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ead6cc-8c64-434d-921c-d0802dd75d89 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:29.413103 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ead6cc-8c64-434d-921c-d0802dd75d89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:29.419864 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335db04a-81e1-42b5-a982-eac789db9217 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 17:04:29.432089 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-335db04a-81e1-42b5-a982-eac789db9217 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 17:04:29.432089 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:04:29.432089 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:04:29.432089 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:04:29.432089 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:04:29.432089 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:04:29.432089 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:04:29.432089 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:04:29.432089 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:04:29.432089 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:04:29.432089 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:04:29.432089 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:04:29.432089 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 17:04:29.432089 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 17:04:29.432089 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 17:04:29.432089 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 17:04:29.433289 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 17:04:29.433289 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 17:04:29.433289 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 17:04:29.433289 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 17:04:29.433289 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:04:29.433289 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:04:29.433289 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:04:29.433289 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:04:29.433289 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:04:29.433289 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:04:29.433289 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:04:29.433289 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Jul 14 17:04:29.433289 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:04:29.433289 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:04:29.433289 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:04:29.433289 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:04:29.434305 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:04:29.434305 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:04:29.434305 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:04:29.434305 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:04:29.434305 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 17:04:29.434305 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 17:04:29.434305 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 17:04:29.434305 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 17:04:29.434305 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 17:04:29.434305 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 17:04:29.434305 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 17:04:29.434305 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Jul 14 17:04:29.435343 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 195/405] 10.222.0.136 () {56 vars in 1119 bytes} [Thu Jul 14 17:04:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 17:04:29.437450 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-84ead6cc-8c64-434d-921c-d0802dd75d89 None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:04:29.438834 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-84ead6cc-8c64-434d-921c-d0802dd75d89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:04:29.442138 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335db04a-81e1-42b5-a982-eac789db9217 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:29.524827 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 211/406] 10.222.0.136 () {58 vars in 1028 bytes} [Thu Jul 14 17:04:29 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 17:04:29.550583 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ead6cc-8c64-434d-921c-d0802dd75d89 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:29.584986 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335db04a-81e1-42b5-a982-eac789db9217 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:29.632302 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:29.637074 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a04ed5-4ecb-4909-98b5-27a370f3910b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:29.640037 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a04ed5-4ecb-4909-98b5-27a370f3910b None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:29.640429 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a04ed5-4ecb-4909-98b5-27a370f3910b None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:29.640815 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a04ed5-4ecb-4909-98b5-27a370f3910b None admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:29.641926 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a04ed5-4ecb-4909-98b5-27a370f3910b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:04:29.642317 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a04ed5-4ecb-4909-98b5-27a370f3910b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:29.643796 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a04ed5-4ecb-4909-98b5-27a370f3910b None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:29.661667 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 196/407] 10.222.0.136 () {56 vars in 1116 bytes} [Thu Jul 14 17:04:29 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 17:04:29.664379 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a04ed5-4ecb-4909-98b5-27a370f3910b None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:29.700699 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ead6cc-8c64-434d-921c-d0802dd75d89 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:29.735666 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:29.783739 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da39a202-31d8-4283-817a-a58bd0be7f86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:29.784659 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da39a202-31d8-4283-817a-a58bd0be7f86 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:29.784994 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da39a202-31d8-4283-817a-a58bd0be7f86 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:29.785296 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da39a202-31d8-4283-817a-a58bd0be7f86 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:29.790356 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a04ed5-4ecb-4909-98b5-27a370f3910b None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:29.817037 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da39a202-31d8-4283-817a-a58bd0be7f86 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 17:04:29.831184 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-da39a202-31d8-4283-817a-a58bd0be7f86 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 17:04:29.831184 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:04:29.831184 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:04:29.831184 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:04:29.831184 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:04:29.831184 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:04:29.831184 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:04:29.831184 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:04:29.831184 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:04:29.831184 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:04:29.831184 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:04:29.831184 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:04:29.831184 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 17:04:29.831184 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 17:04:29.831184 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 17:04:29.831184 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 17:04:29.832178 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 17:04:29.832178 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 17:04:29.832178 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 17:04:29.832178 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 17:04:29.832178 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:04:29.832178 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:04:29.832178 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:04:29.832178 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:04:29.832178 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:04:29.832178 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:04:29.832178 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:04:29.832178 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Jul 14 17:04:29.832178 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:04:29.832178 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:04:29.832178 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:04:29.832178 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:04:29.833594 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:04:29.833594 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:04:29.833594 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:04:29.833594 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:04:29.833594 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 17:04:29.833594 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 17:04:29.833594 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 17:04:29.833594 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 17:04:29.833594 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 17:04:29.833594 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 17:04:29.833594 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 17:04:29.833594 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Jul 14 17:04:29.836777 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 212/408] 10.222.0.136 () {56 vars in 1101 bytes} [Thu Jul 14 17:04:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:04:29.839608 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7160fc-9875-4f3f-ad5a-824b1c349db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:29.840730 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7160fc-9875-4f3f-ad5a-824b1c349db6 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:29.841219 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7160fc-9875-4f3f-ad5a-824b1c349db6 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:29.841773 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7160fc-9875-4f3f-ad5a-824b1c349db6 None admin] PATH_INFO: `/v3/groups/88aff3277a984c00a5903432c1757a32` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:29.843285 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7160fc-9875-4f3f-ad5a-824b1c349db6 None admin] RBAC: Authorizing `identity:get_group(group_id=88aff3277a984c00a5903432c1757a32)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:29.844348 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da39a202-31d8-4283-817a-a58bd0be7f86 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:29.846447 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7160fc-9875-4f3f-ad5a-824b1c349db6 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:29.853570 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 197/409] 10.222.0.136 () {56 vars in 1185 bytes} [Thu Jul 14 17:04:29 2022] GET /identity/v3/groups/88aff3277a984c00a5903432c1757a32 => generated 227 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:04:29.870601 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7160fc-9875-4f3f-ad5a-824b1c349db6 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:29.971474 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da39a202-31d8-4283-817a-a58bd0be7f86 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:30.006062 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:30.024394 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a612cdcd-685b-4eff-8642-c4ae4340132c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:30.025913 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a612cdcd-685b-4eff-8642-c4ae4340132c None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:30.026816 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a612cdcd-685b-4eff-8642-c4ae4340132c None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:30.027511 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a612cdcd-685b-4eff-8642-c4ae4340132c None admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:30.028523 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a612cdcd-685b-4eff-8642-c4ae4340132c None admin] RBAC: Adding query filter params (name=admin) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:04:30.029034 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a612cdcd-685b-4eff-8642-c4ae4340132c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:30.030795 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a612cdcd-685b-4eff-8642-c4ae4340132c None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:30.042090 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 213/410] 10.222.0.136 () {56 vars in 1104 bytes} [Thu Jul 14 17:04:29 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:04:30.047670 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a612cdcd-685b-4eff-8642-c4ae4340132c None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:30.184282 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a612cdcd-685b-4eff-8642-c4ae4340132c None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:30.189990 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7160fc-9875-4f3f-ad5a-824b1c349db6 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:30.243628 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:30.258858 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5497713-0cec-4bd8-af87-bd13c7ac1fe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:30.259733 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5497713-0cec-4bd8-af87-bd13c7ac1fe2 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:30.260029 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5497713-0cec-4bd8-af87-bd13c7ac1fe2 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:30.260313 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5497713-0cec-4bd8-af87-bd13c7ac1fe2 None admin] PATH_INFO: `/v3/groups/dc48be0421c84e64b849cbd6e2cadae0` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:30.262794 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5497713-0cec-4bd8-af87-bd13c7ac1fe2 None admin] RBAC: Authorizing `identity:get_group(group_id=dc48be0421c84e64b849cbd6e2cadae0)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:30.264586 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b9db13-3b3e-4c78-9220-81122c6bf0a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:30.265455 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b9db13-3b3e-4c78-9220-81122c6bf0a7 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:30.265767 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b9db13-3b3e-4c78-9220-81122c6bf0a7 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:30.266052 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b9db13-3b3e-4c78-9220-81122c6bf0a7 None admin] PATH_INFO: `/v3/projects/dc58de68345f40498e25fd3ab4626f7f` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:30.266905 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5497713-0cec-4bd8-af87-bd13c7ac1fe2 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:30.269251 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b9db13-3b3e-4c78-9220-81122c6bf0a7 None admin] RBAC: Authorizing `identity:get_project(project_id=dc58de68345f40498e25fd3ab4626f7f)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:30.271669 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 214/411] 10.222.0.136 () {56 vars in 1185 bytes} [Thu Jul 14 17:04:30 2022] GET /identity/v3/groups/dc48be0421c84e64b849cbd6e2cadae0 => generated 230 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:04:30.272167 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b9db13-3b3e-4c78-9220-81122c6bf0a7 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:30.274316 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5497713-0cec-4bd8-af87-bd13c7ac1fe2 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:30.275593 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 198/412] 10.222.0.136 () {56 vars in 1191 bytes} [Thu Jul 14 17:04:29 2022] GET /identity/v3/projects/dc58de68345f40498e25fd3ab4626f7f => generated 303 bytes in 405 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:04:30.285776 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b9db13-3b3e-4c78-9220-81122c6bf0a7 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:30.428742 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b9db13-3b3e-4c78-9220-81122c6bf0a7 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:30.456553 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:30.468646 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e276bca6-94d3-4b9d-9e6c-096601964b31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:30.469563 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e276bca6-94d3-4b9d-9e6c-096601964b31 None admin] REQUEST_METHOD: `PUT` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:30.469857 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e276bca6-94d3-4b9d-9e6c-096601964b31 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:30.470139 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e276bca6-94d3-4b9d-9e6c-096601964b31 None admin] PATH_INFO: `/v3/projects/dc58de68345f40498e25fd3ab4626f7f/groups/88aff3277a984c00a5903432c1757a32/roles/5e321db416444dc9b5bfce7db763a7ed` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:30.472383 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e276bca6-94d3-4b9d-9e6c-096601964b31 None admin] RBAC: Authorizing `identity:create_grant(project_id=dc58de68345f40498e25fd3ab4626f7f, group_id=88aff3277a984c00a5903432c1757a32, role_id=5e321db416444dc9b5bfce7db763a7ed)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:30.474370 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e276bca6-94d3-4b9d-9e6c-096601964b31 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:30.493207 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 199/413] 10.222.0.136 () {58 vars in 1447 bytes} [Thu Jul 14 17:04:30 2022] PUT /identity/v3/projects/dc58de68345f40498e25fd3ab4626f7f/groups/88aff3277a984c00a5903432c1757a32/roles/5e321db416444dc9b5bfce7db763a7ed => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:04:30.526169 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5497713-0cec-4bd8-af87-bd13c7ac1fe2 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:30.558591 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83fe7fd-2a95-4e29-be04-76e78e4bc448 None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:30.558933 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83fe7fd-2a95-4e29-be04-76e78e4bc448 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:30.559179 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83fe7fd-2a95-4e29-be04-76e78e4bc448 None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:30.560878 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 200/414] 10.222.0.136 () {54 vars in 931 bytes} [Thu Jul 14 17:04:30 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 14 17:04:30.566985 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ede448f-115d-4870-8f4b-8476367a7824 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:30.567915 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ede448f-115d-4870-8f4b-8476367a7824 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:30.568294 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ede448f-115d-4870-8f4b-8476367a7824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:30.572668 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eed3aa-3fa5-4c67-bdbe-3b66aeaf7302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:30.573655 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eed3aa-3fa5-4c67-bdbe-3b66aeaf7302 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:30.573950 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eed3aa-3fa5-4c67-bdbe-3b66aeaf7302 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:30.574236 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eed3aa-3fa5-4c67-bdbe-3b66aeaf7302 None admin] PATH_INFO: `/v3/projects/602fa21468b24207a8f98e92cd2c99ce` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:30.575533 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29eed3aa-3fa5-4c67-bdbe-3b66aeaf7302 None admin] RBAC: Authorizing `identity:get_project(project_id=602fa21468b24207a8f98e92cd2c99ce)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:30.577018 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29eed3aa-3fa5-4c67-bdbe-3b66aeaf7302 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:30.581510 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 215/415] 10.222.0.136 () {56 vars in 1191 bytes} [Thu Jul 14 17:04:30 2022] GET /identity/v3/projects/602fa21468b24207a8f98e92cd2c99ce => generated 345 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:04:30.586840 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eed3aa-3fa5-4c67-bdbe-3b66aeaf7302 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:30.592617 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-8ede448f-115d-4870-8f4b-8476367a7824 None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:04:30.593996 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-8ede448f-115d-4870-8f4b-8476367a7824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:04:30.691321 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:30.720662 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 201/416] 10.222.0.136 () {58 vars in 1028 bytes} [Thu Jul 14 17:04:30 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 17:04:30.731992 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eed3aa-3fa5-4c67-bdbe-3b66aeaf7302 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:30.746073 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ede448f-115d-4870-8f4b-8476367a7824 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:30.768019 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:30.783131 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57db0679-cc95-48f6-b46d-db35edbf1386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:30.784055 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57db0679-cc95-48f6-b46d-db35edbf1386 None admin] REQUEST_METHOD: `PUT` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:30.784348 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57db0679-cc95-48f6-b46d-db35edbf1386 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:30.784631 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57db0679-cc95-48f6-b46d-db35edbf1386 None admin] PATH_INFO: `/v3/projects/602fa21468b24207a8f98e92cd2c99ce/groups/dc48be0421c84e64b849cbd6e2cadae0/roles/284c6314b4d3492085e397a87b0e3b51` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:30.789856 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57db0679-cc95-48f6-b46d-db35edbf1386 None admin] RBAC: Authorizing `identity:create_grant(project_id=602fa21468b24207a8f98e92cd2c99ce, group_id=dc48be0421c84e64b849cbd6e2cadae0, role_id=284c6314b4d3492085e397a87b0e3b51)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:30.791471 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57db0679-cc95-48f6-b46d-db35edbf1386 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:30.809493 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 216/417] 10.222.0.136 () {58 vars in 1447 bytes} [Thu Jul 14 17:04:30 2022] PUT /identity/v3/projects/602fa21468b24207a8f98e92cd2c99ce/groups/dc48be0421c84e64b849cbd6e2cadae0/roles/284c6314b4d3492085e397a87b0e3b51 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 17:04:30.890877 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ede448f-115d-4870-8f4b-8476367a7824 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:30.943149 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a851164-3eab-4c1d-ba4c-950d88cd31d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:30.944057 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a851164-3eab-4c1d-ba4c-950d88cd31d3 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:30.944348 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a851164-3eab-4c1d-ba4c-950d88cd31d3 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:30.944814 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a851164-3eab-4c1d-ba4c-950d88cd31d3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:30.966358 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a851164-3eab-4c1d-ba4c-950d88cd31d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 17:04:30.974947 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-9a851164-3eab-4c1d-ba4c-950d88cd31d3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 17:04:30.974947 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:04:30.974947 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:04:30.974947 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:04:30.974947 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:04:30.974947 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:04:30.974947 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:04:30.974947 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:04:30.974947 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:04:30.974947 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:04:30.974947 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:04:30.974947 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:04:30.974947 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 17:04:30.974947 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 17:04:30.974947 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 17:04:30.974947 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 17:04:30.975912 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 17:04:30.975912 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 17:04:30.975912 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 17:04:30.975912 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 17:04:30.975912 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:04:30.975912 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:04:30.975912 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:04:30.975912 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:04:30.975912 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:04:30.975912 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:04:30.975912 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:04:30.975912 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Jul 14 17:04:30.975912 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:04:30.975912 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:04:30.975912 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:04:30.975912 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:04:30.976797 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:04:30.976797 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:04:30.976797 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:04:30.976797 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:04:30.976797 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 17:04:30.976797 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 17:04:30.976797 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 17:04:30.976797 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 17:04:30.976797 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 17:04:30.976797 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 17:04:30.976797 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 17:04:30.976797 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Jul 14 17:04:30.976797 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 202/418] 10.222.0.136 () {56 vars in 1104 bytes} [Thu Jul 14 17:04:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 17:04:30.984093 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57db0679-cc95-48f6-b46d-db35edbf1386 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:31.120709 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57db0679-cc95-48f6-b46d-db35edbf1386 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:31.156496 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e913cef-fce6-466b-9372-abecbd54561a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:31.157190 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e913cef-fce6-466b-9372-abecbd54561a None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:31.157514 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e913cef-fce6-466b-9372-abecbd54561a None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:31.157833 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e913cef-fce6-466b-9372-abecbd54561a None admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:31.158632 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e913cef-fce6-466b-9372-abecbd54561a None admin] RBAC: Adding query filter params (name=member) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:04:31.158945 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e913cef-fce6-466b-9372-abecbd54561a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:31.160448 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e913cef-fce6-466b-9372-abecbd54561a None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:31.171015 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 217/419] 10.222.0.136 () {56 vars in 1106 bytes} [Thu Jul 14 17:04:30 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:04:31.178800 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a851164-3eab-4c1d-ba4c-950d88cd31d3 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:31.228530 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:31.298406 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a851164-3eab-4c1d-ba4c-950d88cd31d3 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:31.353344 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e6360f-5816-45e5-b0df-f523878a08be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:31.354330 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e6360f-5816-45e5-b0df-f523878a08be None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:31.354770 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e6360f-5816-45e5-b0df-f523878a08be None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:31.355255 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e6360f-5816-45e5-b0df-f523878a08be None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:31.434802 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e6360f-5816-45e5-b0df-f523878a08be None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:31.436500 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e6360f-5816-45e5-b0df-f523878a08be None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:31.484709 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:31.559457 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 203/420] 10.222.0.136 () {58 vars in 1287 bytes} [Thu Jul 14 17:04:31 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 17:04:31.565065 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e913cef-fce6-466b-9372-abecbd54561a None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:31.624260 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:31.683131 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e913cef-fce6-466b-9372-abecbd54561a None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:31.720031 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6cc44b-5e03-4115-b92a-d56bc64b5c01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:31.721185 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6cc44b-5e03-4115-b92a-d56bc64b5c01 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:31.721712 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6cc44b-5e03-4115-b92a-d56bc64b5c01 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:31.722304 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6cc44b-5e03-4115-b92a-d56bc64b5c01 None admin] PATH_INFO: `/v3/projects/dc58de68345f40498e25fd3ab4626f7f` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:31.723918 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6cc44b-5e03-4115-b92a-d56bc64b5c01 None admin] RBAC: Authorizing `identity:get_project(project_id=dc58de68345f40498e25fd3ab4626f7f)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:31.725645 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6cc44b-5e03-4115-b92a-d56bc64b5c01 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:31.727875 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 218/421] 10.222.0.136 () {56 vars in 1191 bytes} [Thu Jul 14 17:04:31 2022] GET /identity/v3/projects/dc58de68345f40498e25fd3ab4626f7f => generated 303 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:04:31.738939 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e6360f-5816-45e5-b0df-f523878a08be None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:31.926057 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e6360f-5816-45e5-b0df-f523878a08be None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:32.035281 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c15cb72-71b9-4b3b-99dd-178e084199b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:32.037089 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c15cb72-71b9-4b3b-99dd-178e084199b9 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:32.037529 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c15cb72-71b9-4b3b-99dd-178e084199b9 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:32.038173 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c15cb72-71b9-4b3b-99dd-178e084199b9 None admin] PATH_INFO: `/v3/groups/88aff3277a984c00a5903432c1757a32` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:32.042266 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c15cb72-71b9-4b3b-99dd-178e084199b9 None admin] RBAC: Authorizing `identity:get_group(group_id=88aff3277a984c00a5903432c1757a32)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:32.043904 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c15cb72-71b9-4b3b-99dd-178e084199b9 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:32.045876 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 204/422] 10.222.0.136 () {56 vars in 1185 bytes} [Thu Jul 14 17:04:31 2022] GET /identity/v3/groups/88aff3277a984c00a5903432c1757a32 => generated 227 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:04:32.052497 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6cc44b-5e03-4115-b92a-d56bc64b5c01 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:32.096623 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd8556d-02d2-4554-b083-457cf9b861dd None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:32.096867 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd8556d-02d2-4554-b083-457cf9b861dd None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:32.097037 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd8556d-02d2-4554-b083-457cf9b861dd None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:32.099229 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 205/423] 10.222.0.136 () {54 vars in 931 bytes} [Thu Jul 14 17:04:32 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:04:32.105338 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae955bde-a1e5-414b-a3b0-12d5846650ee None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:32.105658 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae955bde-a1e5-414b-a3b0-12d5846650ee None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:32.106205 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae955bde-a1e5-414b-a3b0-12d5846650ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:32.123264 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-ae955bde-a1e5-414b-a3b0-12d5846650ee None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:04:32.124585 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-ae955bde-a1e5-414b-a3b0-12d5846650ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:04:32.137577 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:32.245223 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 206/424] 10.222.0.136 () {58 vars in 1028 bytes} [Thu Jul 14 17:04:32 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 17:04:32.248846 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6cc44b-5e03-4115-b92a-d56bc64b5c01 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:32.269888 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:32.281577 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae955bde-a1e5-414b-a3b0-12d5846650ee None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:32.294314 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783244ba-0841-4f24-8e80-b7cc0b7dcb86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:32.295199 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783244ba-0841-4f24-8e80-b7cc0b7dcb86 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:32.295698 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783244ba-0841-4f24-8e80-b7cc0b7dcb86 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:32.296124 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783244ba-0841-4f24-8e80-b7cc0b7dcb86 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:32.297105 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783244ba-0841-4f24-8e80-b7cc0b7dcb86 None admin] RBAC: Adding query filter params (group.id=88aff3277a984c00a5903432c1757a32, role.id=7441b1b1ab104537addd90a2471822f3, scope.project.id=dc58de68345f40498e25fd3ab4626f7f) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:04:32.297584 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783244ba-0841-4f24-8e80-b7cc0b7dcb86 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:32.299157 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783244ba-0841-4f24-8e80-b7cc0b7dcb86 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:32.310422 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 219/425] 10.222.0.136 () {56 vars in 1381 bytes} [Thu Jul 14 17:04:32 2022] GET /identity/v3/role_assignments?group.id=88aff3277a984c00a5903432c1757a32&scope.project.id=dc58de68345f40498e25fd3ab4626f7f&role.id=7441b1b1ab104537addd90a2471822f3 => generated 613 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:04:32.375473 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1851d64c-a42b-4d64-84cb-1f786073f1e8 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:32.375825 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1851d64c-a42b-4d64-84cb-1f786073f1e8 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:32.376037 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1851d64c-a42b-4d64-84cb-1f786073f1e8 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:32.377665 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 220/426] 10.222.0.136 () {54 vars in 931 bytes} [Thu Jul 14 17:04:32 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 14 17:04:32.383690 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3f2e59-1d25-432e-8920-426e7bf90358 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:32.384018 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3f2e59-1d25-432e-8920-426e7bf90358 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:32.384252 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3f2e59-1d25-432e-8920-426e7bf90358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:32.412567 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae955bde-a1e5-414b-a3b0-12d5846650ee None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:32.446745 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-4f3f2e59-1d25-432e-8920-426e7bf90358 None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:04:32.447981 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-4f3f2e59-1d25-432e-8920-426e7bf90358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:04:32.452602 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8878b7-5820-4eb6-94e3-d7781c5d5176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:32.453436 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8878b7-5820-4eb6-94e3-d7781c5d5176 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:32.453757 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8878b7-5820-4eb6-94e3-d7781c5d5176 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:32.454037 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8878b7-5820-4eb6-94e3-d7781c5d5176 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:32.468540 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8878b7-5820-4eb6-94e3-d7781c5d5176 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 17:04:32.478335 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-9f8878b7-5820-4eb6-94e3-d7781c5d5176 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 17:04:32.478335 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:04:32.478335 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:04:32.478335 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:04:32.478335 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:04:32.478335 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:04:32.478335 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:04:32.478335 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:04:32.478335 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:04:32.478335 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:04:32.478335 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:04:32.478335 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:04:32.478335 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 17:04:32.478335 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 17:04:32.478335 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 17:04:32.478335 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 17:04:32.479287 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 17:04:32.479287 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 17:04:32.479287 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 17:04:32.479287 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 17:04:32.479287 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:04:32.479287 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:04:32.479287 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:04:32.479287 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:04:32.479287 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:04:32.479287 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:04:32.479287 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:04:32.479287 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Jul 14 17:04:32.479287 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:04:32.479287 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:04:32.479287 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:04:32.479287 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:04:32.480092 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:04:32.480092 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:04:32.480092 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:04:32.480092 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:04:32.480092 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 17:04:32.480092 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 17:04:32.480092 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 17:04:32.480092 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 17:04:32.480092 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 17:04:32.480092 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 17:04:32.480092 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 17:04:32.480092 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Jul 14 17:04:32.480699 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 207/427] 10.222.0.136 () {56 vars in 1119 bytes} [Thu Jul 14 17:04:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 17:04:32.487807 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8878b7-5820-4eb6-94e3-d7781c5d5176 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:32.496923 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:32.573520 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 221/428] 10.222.0.136 () {58 vars in 1028 bytes} [Thu Jul 14 17:04:32 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 17:04:32.612150 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3f2e59-1d25-432e-8920-426e7bf90358 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:32.638000 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8878b7-5820-4eb6-94e3-d7781c5d5176 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:32.687158 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcf62ac-b2db-44de-b665-194acc3f7886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:32.687846 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcf62ac-b2db-44de-b665-194acc3f7886 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:32.688133 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcf62ac-b2db-44de-b665-194acc3f7886 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:32.688511 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcf62ac-b2db-44de-b665-194acc3f7886 None admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:32.689262 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcf62ac-b2db-44de-b665-194acc3f7886 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:04:32.689609 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcf62ac-b2db-44de-b665-194acc3f7886 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:32.690989 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcf62ac-b2db-44de-b665-194acc3f7886 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:32.700380 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 208/429] 10.222.0.136 () {56 vars in 1116 bytes} [Thu Jul 14 17:04:32 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:04:32.705854 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcf62ac-b2db-44de-b665-194acc3f7886 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:32.731436 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3f2e59-1d25-432e-8920-426e7bf90358 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:32.744539 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:32.775828 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf43085-0467-46b4-b1eb-85f3612b17cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:32.776639 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf43085-0467-46b4-b1eb-85f3612b17cb None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:32.776922 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf43085-0467-46b4-b1eb-85f3612b17cb None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:32.777192 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf43085-0467-46b4-b1eb-85f3612b17cb None admin] PATH_INFO: `/v3/roles/member` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:32.787912 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:32.793781 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf43085-0467-46b4-b1eb-85f3612b17cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 17:04:32.802713 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-1bf43085-0467-46b4-b1eb-85f3612b17cb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 17:04:32.802713 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:04:32.802713 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:04:32.802713 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:04:32.802713 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:04:32.802713 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:04:32.802713 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:04:32.802713 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:04:32.802713 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:04:32.802713 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:04:32.802713 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:04:32.802713 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:04:32.802713 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 17:04:32.802713 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 17:04:32.802713 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 17:04:32.802713 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 17:04:32.803633 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 17:04:32.803633 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 17:04:32.803633 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 17:04:32.803633 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 17:04:32.803633 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:04:32.803633 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:04:32.803633 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:04:32.803633 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:04:32.803633 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:04:32.803633 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:04:32.803633 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:04:32.803633 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Jul 14 17:04:32.803633 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:04:32.803633 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:04:32.803633 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:04:32.803633 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:04:32.809454 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:04:32.809454 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:04:32.809454 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:04:32.809454 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:04:32.809454 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 17:04:32.809454 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 17:04:32.809454 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 17:04:32.809454 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 17:04:32.809454 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 17:04:32.809454 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 17:04:32.809454 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 17:04:32.809454 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Jul 14 17:04:32.809454 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 222/430] 10.222.0.136 () {56 vars in 1104 bytes} [Thu Jul 14 17:04:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 17:04:32.812935 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf43085-0467-46b4-b1eb-85f3612b17cb None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:32.850063 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcf62ac-b2db-44de-b665-194acc3f7886 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:32.887165 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a445785-e8fb-4022-9c40-2a0238ced780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:32.887819 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a445785-e8fb-4022-9c40-2a0238ced780 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:32.888113 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a445785-e8fb-4022-9c40-2a0238ced780 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:32.888374 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a445785-e8fb-4022-9c40-2a0238ced780 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:32.930629 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf43085-0467-46b4-b1eb-85f3612b17cb None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:32.966617 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a445785-e8fb-4022-9c40-2a0238ced780 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:32.968384 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a445785-e8fb-4022-9c40-2a0238ced780 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:32.970621 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c7f334-7bac-4745-a61f-3e61bc7750f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:32.971625 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c7f334-7bac-4745-a61f-3e61bc7750f0 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:32.972421 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c7f334-7bac-4745-a61f-3e61bc7750f0 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:32.972969 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c7f334-7bac-4745-a61f-3e61bc7750f0 None admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:32.974920 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c7f334-7bac-4745-a61f-3e61bc7750f0 None admin] RBAC: Adding query filter params (name=member) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:04:32.975693 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c7f334-7bac-4745-a61f-3e61bc7750f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:32.977445 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c7f334-7bac-4745-a61f-3e61bc7750f0 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:32.992294 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 223/431] 10.222.0.136 () {56 vars in 1106 bytes} [Thu Jul 14 17:04:32 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:04:32.994231 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c7f334-7bac-4745-a61f-3e61bc7750f0 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:33.028491 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:33.038171 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:33.085715 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 209/432] 10.222.0.136 () {58 vars in 1287 bytes} [Thu Jul 14 17:04:32 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 14 17:04:33.087165 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a445785-e8fb-4022-9c40-2a0238ced780 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:33.116276 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c7f334-7bac-4745-a61f-3e61bc7750f0 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:33.155736 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f6696e-9fc0-4716-8b23-b735bc2ae3a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:33.157011 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f6696e-9fc0-4716-8b23-b735bc2ae3a3 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:33.157499 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f6696e-9fc0-4716-8b23-b735bc2ae3a3 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:33.158012 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f6696e-9fc0-4716-8b23-b735bc2ae3a3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:33.213978 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a445785-e8fb-4022-9c40-2a0238ced780 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:33.243591 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f6696e-9fc0-4716-8b23-b735bc2ae3a3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:33.245514 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f6696e-9fc0-4716-8b23-b735bc2ae3a3 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:33.251868 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0f5fff-2ad5-45d4-bd51-d29a8c685b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:33.252741 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0f5fff-2ad5-45d4-bd51-d29a8c685b75 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:33.253031 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0f5fff-2ad5-45d4-bd51-d29a8c685b75 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:33.253306 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0f5fff-2ad5-45d4-bd51-d29a8c685b75 None admin] PATH_INFO: `/v3/projects/8bd70064655e4aa5832910aaa0dd0116` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:33.254682 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0f5fff-2ad5-45d4-bd51-d29a8c685b75 None admin] RBAC: Authorizing `identity:get_project(project_id=8bd70064655e4aa5832910aaa0dd0116)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:33.256664 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0f5fff-2ad5-45d4-bd51-d29a8c685b75 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:33.258752 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 210/433] 10.222.0.136 () {56 vars in 1191 bytes} [Thu Jul 14 17:04:33 2022] GET /identity/v3/projects/8bd70064655e4aa5832910aaa0dd0116 => generated 299 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:04:33.263934 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0f5fff-2ad5-45d4-bd51-d29a8c685b75 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:33.287032 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:33.299021 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:33.379671 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 224/434] 10.222.0.136 () {58 vars in 1287 bytes} [Thu Jul 14 17:04:32 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 17:04:33.381641 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8a920c-1a2a-43e5-b88d-1ac46d940397 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:33.381936 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8a920c-1a2a-43e5-b88d-1ac46d940397 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:33.382218 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8a920c-1a2a-43e5-b88d-1ac46d940397 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:33.383623 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 225/435] 10.222.0.136 () {54 vars in 931 bytes} [Thu Jul 14 17:04:33 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:04:33.388621 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a354893-a124-4575-997d-d346bb6c02ea None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:33.388921 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a354893-a124-4575-997d-d346bb6c02ea None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:33.389208 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a354893-a124-4575-997d-d346bb6c02ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:33.390525 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0f5fff-2ad5-45d4-bd51-d29a8c685b75 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:33.406155 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-1a354893-a124-4575-997d-d346bb6c02ea None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:04:33.407351 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-1a354893-a124-4575-997d-d346bb6c02ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:04:33.427607 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e86352-bb95-416a-95e2-507b77814e19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:33.429351 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e86352-bb95-416a-95e2-507b77814e19 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:33.429878 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e86352-bb95-416a-95e2-507b77814e19 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:33.430514 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e86352-bb95-416a-95e2-507b77814e19 None admin] PATH_INFO: `/v3/groups/88aff3277a984c00a5903432c1757a32` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:33.432079 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e86352-bb95-416a-95e2-507b77814e19 None admin] RBAC: Authorizing `identity:get_group(group_id=88aff3277a984c00a5903432c1757a32)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:33.434224 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e86352-bb95-416a-95e2-507b77814e19 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:33.436523 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 211/436] 10.222.0.136 () {56 vars in 1185 bytes} [Thu Jul 14 17:04:33 2022] GET /identity/v3/groups/88aff3277a984c00a5903432c1757a32 => generated 227 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 17:04:33.438143 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e86352-bb95-416a-95e2-507b77814e19 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:33.484607 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 226/437] 10.222.0.136 () {58 vars in 1028 bytes} [Thu Jul 14 17:04:33 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 17:04:33.485763 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a354893-a124-4575-997d-d346bb6c02ea None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:33.563136 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:33.563433 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:33.566842 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e86352-bb95-416a-95e2-507b77814e19 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:33.608005 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a354893-a124-4575-997d-d346bb6c02ea None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:33.608557 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d48de0-064d-4c46-bf80-e2c9f3ffd8d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:33.609212 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d48de0-064d-4c46-bf80-e2c9f3ffd8d5 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:33.609785 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d48de0-064d-4c46-bf80-e2c9f3ffd8d5 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:33.610068 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d48de0-064d-4c46-bf80-e2c9f3ffd8d5 None admin] PATH_INFO: `/v3/projects/8bd70064655e4aa5832910aaa0dd0116` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:33.612190 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d48de0-064d-4c46-bf80-e2c9f3ffd8d5 None admin] RBAC: Authorizing `identity:get_project(project_id=8bd70064655e4aa5832910aaa0dd0116)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:33.613677 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d48de0-064d-4c46-bf80-e2c9f3ffd8d5 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:33.620041 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 212/438] 10.222.0.136 () {56 vars in 1191 bytes} [Thu Jul 14 17:04:33 2022] GET /identity/v3/projects/8bd70064655e4aa5832910aaa0dd0116 => generated 299 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:04:33.620041 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d48de0-064d-4c46-bf80-e2c9f3ffd8d5 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:33.644874 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6257c7-d334-4c33-a336-b85ec85b3291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:33.645692 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6257c7-d334-4c33-a336-b85ec85b3291 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:33.646013 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6257c7-d334-4c33-a336-b85ec85b3291 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:33.646287 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6257c7-d334-4c33-a336-b85ec85b3291 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:33.647122 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6257c7-d334-4c33-a336-b85ec85b3291 None admin] RBAC: Adding query filter params (group.id=88aff3277a984c00a5903432c1757a32, role.id=5e321db416444dc9b5bfce7db763a7ed, scope.project.id=8bd70064655e4aa5832910aaa0dd0116) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:04:33.647436 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6257c7-d334-4c33-a336-b85ec85b3291 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:33.648870 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6257c7-d334-4c33-a336-b85ec85b3291 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:33.655262 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 227/439] 10.222.0.136 () {56 vars in 1381 bytes} [Thu Jul 14 17:04:33 2022] GET /identity/v3/role_assignments?group.id=88aff3277a984c00a5903432c1757a32&scope.project.id=8bd70064655e4aa5832910aaa0dd0116&role.id=5e321db416444dc9b5bfce7db763a7ed => generated 613 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:04:33.656057 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6257c7-d334-4c33-a336-b85ec85b3291 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:33.747022 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d48de0-064d-4c46-bf80-e2c9f3ffd8d5 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:33.792038 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6257c7-d334-4c33-a336-b85ec85b3291 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:33.797744 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73627416-6884-44dc-be3a-d5b52af7b370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:33.798574 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73627416-6884-44dc-be3a-d5b52af7b370 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:33.798861 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73627416-6884-44dc-be3a-d5b52af7b370 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:33.799147 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73627416-6884-44dc-be3a-d5b52af7b370 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:33.812026 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73627416-6884-44dc-be3a-d5b52af7b370 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 17:04:33.820718 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:33.822606 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-73627416-6884-44dc-be3a-d5b52af7b370 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 17:04:33.822606 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:04:33.822606 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:04:33.822606 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:04:33.822606 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:04:33.822606 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:04:33.822606 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:04:33.822606 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:04:33.822606 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:04:33.822606 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:04:33.822606 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:04:33.822606 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:04:33.822606 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 17:04:33.822606 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 17:04:33.822606 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 17:04:33.822606 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 17:04:33.823501 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 17:04:33.823501 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 17:04:33.823501 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 17:04:33.823501 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 17:04:33.823501 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:04:33.823501 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:04:33.823501 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:04:33.823501 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:04:33.823501 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:04:33.823501 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:04:33.823501 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:04:33.823501 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Jul 14 17:04:33.823501 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:04:33.823501 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:04:33.823501 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:04:33.823501 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:04:33.824320 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:04:33.824320 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:04:33.824320 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:04:33.824320 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:04:33.824320 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 17:04:33.824320 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 17:04:33.824320 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 17:04:33.824320 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 17:04:33.824320 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 17:04:33.824320 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 17:04:33.824320 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 17:04:33.824320 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Jul 14 17:04:33.824320 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 213/440] 10.222.0.136 () {56 vars in 1119 bytes} [Thu Jul 14 17:04:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:04:33.825298 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81751ba-5880-4255-a02b-222864fbb82d None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:33.825485 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81751ba-5880-4255-a02b-222864fbb82d None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:33.825795 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81751ba-5880-4255-a02b-222864fbb82d None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:33.827354 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 214/441] 10.222.0.136 () {54 vars in 931 bytes} [Thu Jul 14 17:04:33 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:04:33.830079 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81751ba-5880-4255-a02b-222864fbb82d None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:33.836556 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ef2a14-12e1-4640-bb6c-d30c23f3bf33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:33.837428 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ef2a14-12e1-4640-bb6c-d30c23f3bf33 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:33.838599 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ef2a14-12e1-4640-bb6c-d30c23f3bf33 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:33.838599 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ef2a14-12e1-4640-bb6c-d30c23f3bf33 None admin] PATH_INFO: `/v3/groups/88aff3277a984c00a5903432c1757a32` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:33.839296 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ef2a14-12e1-4640-bb6c-d30c23f3bf33 None admin] RBAC: Authorizing `identity:get_group(group_id=88aff3277a984c00a5903432c1757a32)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:33.840761 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ef2a14-12e1-4640-bb6c-d30c23f3bf33 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:33.843926 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 228/442] 10.222.0.136 () {56 vars in 1185 bytes} [Thu Jul 14 17:04:33 2022] GET /identity/v3/groups/88aff3277a984c00a5903432c1757a32 => generated 227 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:04:33.845110 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74887af-d013-4155-b8da-641d384ef0e1 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:33.845410 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74887af-d013-4155-b8da-641d384ef0e1 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:33.845885 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74887af-d013-4155-b8da-641d384ef0e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:33.864392 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:33.864837 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-e74887af-d013-4155-b8da-641d384ef0e1 None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:04:33.866750 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-e74887af-d013-4155-b8da-641d384ef0e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:04:33.940923 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 229/443] 10.222.0.136 () {58 vars in 1028 bytes} [Thu Jul 14 17:04:33 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 17:04:33.941743 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74887af-d013-4155-b8da-641d384ef0e1 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:33.958684 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81751ba-5880-4255-a02b-222864fbb82d None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:33.994367 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26e5ac5-9d78-4f57-bc74-636c46fe998e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:33.995019 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26e5ac5-9d78-4f57-bc74-636c46fe998e None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:33.995308 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26e5ac5-9d78-4f57-bc74-636c46fe998e None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:33.995583 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26e5ac5-9d78-4f57-bc74-636c46fe998e None admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:33.996321 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26e5ac5-9d78-4f57-bc74-636c46fe998e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:04:33.996627 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26e5ac5-9d78-4f57-bc74-636c46fe998e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:33.998036 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26e5ac5-9d78-4f57-bc74-636c46fe998e None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:34.006358 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 215/444] 10.222.0.136 () {56 vars in 1116 bytes} [Thu Jul 14 17:04:33 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 17:04:34.007135 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26e5ac5-9d78-4f57-bc74-636c46fe998e None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:34.051288 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74887af-d013-4155-b8da-641d384ef0e1 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:34.077758 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:34.089079 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857dffeb-3a09-41b5-9419-98bade1ab1be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:34.089941 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857dffeb-3a09-41b5-9419-98bade1ab1be None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:34.090229 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857dffeb-3a09-41b5-9419-98bade1ab1be None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:34.090569 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857dffeb-3a09-41b5-9419-98bade1ab1be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:34.091365 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857dffeb-3a09-41b5-9419-98bade1ab1be None admin] RBAC: Adding query filter params (group.id=88aff3277a984c00a5903432c1757a32, role.id=7441b1b1ab104537addd90a2471822f3, scope.project.id=8bd70064655e4aa5832910aaa0dd0116) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:04:34.091685 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857dffeb-3a09-41b5-9419-98bade1ab1be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:34.093123 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857dffeb-3a09-41b5-9419-98bade1ab1be None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:34.097755 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:34.099317 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 230/445] 10.222.0.136 () {56 vars in 1381 bytes} [Thu Jul 14 17:04:33 2022] GET /identity/v3/role_assignments?group.id=88aff3277a984c00a5903432c1757a32&scope.project.id=8bd70064655e4aa5832910aaa0dd0116&role.id=7441b1b1ab104537addd90a2471822f3 => generated 613 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:04:34.100286 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857dffeb-3a09-41b5-9419-98bade1ab1be None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:34.108755 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26e5ac5-9d78-4f57-bc74-636c46fe998e None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:34.151418 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99187212-60bc-47eb-9db8-f68ef3ce32d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:34.152232 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99187212-60bc-47eb-9db8-f68ef3ce32d6 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:34.152519 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99187212-60bc-47eb-9db8-f68ef3ce32d6 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:34.152798 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99187212-60bc-47eb-9db8-f68ef3ce32d6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:34.166083 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99187212-60bc-47eb-9db8-f68ef3ce32d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 17:04:34.174550 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-99187212-60bc-47eb-9db8-f68ef3ce32d6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 17:04:34.174550 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:04:34.174550 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:04:34.174550 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:04:34.174550 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:04:34.174550 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:04:34.174550 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:04:34.174550 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:04:34.174550 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:04:34.174550 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:04:34.174550 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:04:34.174550 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:04:34.174550 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 17:04:34.174550 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 17:04:34.174550 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 17:04:34.174550 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 17:04:34.175574 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 17:04:34.175574 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 17:04:34.175574 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 17:04:34.175574 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 17:04:34.175574 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:04:34.175574 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:04:34.175574 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:04:34.175574 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:04:34.175574 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:04:34.175574 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:04:34.175574 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:04:34.175574 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Jul 14 17:04:34.175574 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:04:34.175574 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:04:34.175574 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:04:34.175574 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:04:34.176771 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:04:34.176771 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:04:34.176771 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:04:34.176771 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:04:34.176771 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 17:04:34.176771 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 17:04:34.176771 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 17:04:34.176771 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 17:04:34.176771 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 17:04:34.176771 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 17:04:34.176771 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 17:04:34.176771 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Jul 14 17:04:34.182018 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 216/446] 10.222.0.136 () {56 vars in 1101 bytes} [Thu Jul 14 17:04:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:04:34.182999 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99187212-60bc-47eb-9db8-f68ef3ce32d6 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:34.228554 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857dffeb-3a09-41b5-9419-98bade1ab1be None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:34.267919 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0efbd04-87ab-42df-bcf2-f1ec2b0c4f59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:34.268584 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0efbd04-87ab-42df-bcf2-f1ec2b0c4f59 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:34.268867 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0efbd04-87ab-42df-bcf2-f1ec2b0c4f59 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:34.269142 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0efbd04-87ab-42df-bcf2-f1ec2b0c4f59 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:34.305623 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99187212-60bc-47eb-9db8-f68ef3ce32d6 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:34.338060 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:34.351107 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6785046e-f195-44a2-b5cf-b2c188f2d5a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:34.351908 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6785046e-f195-44a2-b5cf-b2c188f2d5a4 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:34.352196 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6785046e-f195-44a2-b5cf-b2c188f2d5a4 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:34.352482 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6785046e-f195-44a2-b5cf-b2c188f2d5a4 None admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:34.353230 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6785046e-f195-44a2-b5cf-b2c188f2d5a4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:04:34.353576 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6785046e-f195-44a2-b5cf-b2c188f2d5a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:34.354276 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0efbd04-87ab-42df-bcf2-f1ec2b0c4f59 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:34.356250 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0efbd04-87ab-42df-bcf2-f1ec2b0c4f59 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:34.356388 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6785046e-f195-44a2-b5cf-b2c188f2d5a4 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:34.366225 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 217/447] 10.222.0.136 () {56 vars in 1104 bytes} [Thu Jul 14 17:04:34 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:04:34.371933 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6785046e-f195-44a2-b5cf-b2c188f2d5a4 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:34.387697 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:34.479785 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 231/448] 10.222.0.136 () {58 vars in 1287 bytes} [Thu Jul 14 17:04:34 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 17:04:34.485491 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0efbd04-87ab-42df-bcf2-f1ec2b0c4f59 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:34.492454 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6785046e-f195-44a2-b5cf-b2c188f2d5a4 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:34.532769 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e358b60-045c-4bf3-9067-b7d6044a2bcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:34.533433 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e358b60-045c-4bf3-9067-b7d6044a2bcf None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:34.533774 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e358b60-045c-4bf3-9067-b7d6044a2bcf None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:34.534055 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e358b60-045c-4bf3-9067-b7d6044a2bcf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:34.587004 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:34.610354 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0efbd04-87ab-42df-bcf2-f1ec2b0c4f59 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:34.625670 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e358b60-045c-4bf3-9067-b7d6044a2bcf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:34.627944 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e358b60-045c-4bf3-9067-b7d6044a2bcf None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:34.642453 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:34.651588 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7792ca80-9195-416b-af03-a2a680ceb39b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:34.652463 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7792ca80-9195-416b-af03-a2a680ceb39b None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:34.652749 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7792ca80-9195-416b-af03-a2a680ceb39b None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:34.653032 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7792ca80-9195-416b-af03-a2a680ceb39b None admin] PATH_INFO: `/v3/projects/dc58de68345f40498e25fd3ab4626f7f` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:34.654271 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7792ca80-9195-416b-af03-a2a680ceb39b None admin] RBAC: Authorizing `identity:get_project(project_id=dc58de68345f40498e25fd3ab4626f7f)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:34.655724 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7792ca80-9195-416b-af03-a2a680ceb39b None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:34.657468 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 232/449] 10.222.0.136 () {56 vars in 1191 bytes} [Thu Jul 14 17:04:34 2022] GET /identity/v3/projects/dc58de68345f40498e25fd3ab4626f7f => generated 303 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 17:04:34.663559 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7792ca80-9195-416b-af03-a2a680ceb39b None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:34.759672 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 218/450] 10.222.0.136 () {58 vars in 1287 bytes} [Thu Jul 14 17:04:34 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 14 17:04:34.765266 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e358b60-045c-4bf3-9067-b7d6044a2bcf None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:34.791458 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7792ca80-9195-416b-af03-a2a680ceb39b None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:34.835483 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bcc4b4-81ac-40c6-8e48-8a2c5b9d54cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:34.836345 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bcc4b4-81ac-40c6-8e48-8a2c5b9d54cf None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:34.836629 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bcc4b4-81ac-40c6-8e48-8a2c5b9d54cf None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:34.836902 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bcc4b4-81ac-40c6-8e48-8a2c5b9d54cf None admin] PATH_INFO: `/v3/groups/88aff3277a984c00a5903432c1757a32` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:34.838173 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bcc4b4-81ac-40c6-8e48-8a2c5b9d54cf None admin] RBAC: Authorizing `identity:get_group(group_id=88aff3277a984c00a5903432c1757a32)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:34.839602 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bcc4b4-81ac-40c6-8e48-8a2c5b9d54cf None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:34.841215 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 233/451] 10.222.0.136 () {56 vars in 1185 bytes} [Thu Jul 14 17:04:34 2022] GET /identity/v3/groups/88aff3277a984c00a5903432c1757a32 => generated 227 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:04:34.846835 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bcc4b4-81ac-40c6-8e48-8a2c5b9d54cf None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:34.871979 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:34.888339 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e358b60-045c-4bf3-9067-b7d6044a2bcf None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:34.905730 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:34.931544 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8094596-5cf2-41cc-8e0c-9b8c084675b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:34.932436 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8094596-5cf2-41cc-8e0c-9b8c084675b2 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:34.932707 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8094596-5cf2-41cc-8e0c-9b8c084675b2 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:34.932987 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8094596-5cf2-41cc-8e0c-9b8c084675b2 None admin] PATH_INFO: `/v3/projects/602fa21468b24207a8f98e92cd2c99ce` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:34.934270 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8094596-5cf2-41cc-8e0c-9b8c084675b2 None admin] RBAC: Authorizing `identity:get_project(project_id=602fa21468b24207a8f98e92cd2c99ce)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:34.935724 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8094596-5cf2-41cc-8e0c-9b8c084675b2 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:34.937724 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 219/452] 10.222.0.136 () {56 vars in 1191 bytes} [Thu Jul 14 17:04:34 2022] GET /identity/v3/projects/602fa21468b24207a8f98e92cd2c99ce => generated 345 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 17:04:34.943047 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8094596-5cf2-41cc-8e0c-9b8c084675b2 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:34.965531 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bcc4b4-81ac-40c6-8e48-8a2c5b9d54cf None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:35.003363 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d0a983-d8b5-41e5-96d9-c76f612f01dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:35.004028 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d0a983-d8b5-41e5-96d9-c76f612f01dc None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:35.004314 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d0a983-d8b5-41e5-96d9-c76f612f01dc None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:35.005123 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d0a983-d8b5-41e5-96d9-c76f612f01dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:35.006022 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d0a983-d8b5-41e5-96d9-c76f612f01dc None admin] RBAC: Adding query filter params (group.id=88aff3277a984c00a5903432c1757a32, role.id=5e321db416444dc9b5bfce7db763a7ed, scope.project.id=dc58de68345f40498e25fd3ab4626f7f) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:04:35.006373 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d0a983-d8b5-41e5-96d9-c76f612f01dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:35.007928 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d0a983-d8b5-41e5-96d9-c76f612f01dc None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:35.014578 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 234/453] 10.222.0.136 () {56 vars in 1381 bytes} [Thu Jul 14 17:04:34 2022] GET /identity/v3/role_assignments?group.id=88aff3277a984c00a5903432c1757a32&scope.project.id=dc58de68345f40498e25fd3ab4626f7f&role.id=5e321db416444dc9b5bfce7db763a7ed => generated 613 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:04:35.061269 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8094596-5cf2-41cc-8e0c-9b8c084675b2 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:35.100984 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd94884-bfe3-4388-9e42-d9884fc3bf14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:35.102268 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd94884-bfe3-4388-9e42-d9884fc3bf14 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:35.102702 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd94884-bfe3-4388-9e42-d9884fc3bf14 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:35.103128 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd94884-bfe3-4388-9e42-d9884fc3bf14 None admin] PATH_INFO: `/v3/groups/dc48be0421c84e64b849cbd6e2cadae0` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:35.104564 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd94884-bfe3-4388-9e42-d9884fc3bf14 None admin] RBAC: Authorizing `identity:get_group(group_id=dc48be0421c84e64b849cbd6e2cadae0)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:35.106527 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd94884-bfe3-4388-9e42-d9884fc3bf14 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:35.108777 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 220/454] 10.222.0.136 () {56 vars in 1185 bytes} [Thu Jul 14 17:04:34 2022] GET /identity/v3/groups/dc48be0421c84e64b849cbd6e2cadae0 => generated 230 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 17:04:35.115015 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d0a983-d8b5-41e5-96d9-c76f612f01dc None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:35.226725 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:35.240849 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d0a983-d8b5-41e5-96d9-c76f612f01dc None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:35.274911 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff43e352-1805-4b60-a08d-d5cb7cc3dcb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:35.275501 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff43e352-1805-4b60-a08d-d5cb7cc3dcb4 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:35.275792 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff43e352-1805-4b60-a08d-d5cb7cc3dcb4 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:35.276069 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff43e352-1805-4b60-a08d-d5cb7cc3dcb4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:35.276903 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff43e352-1805-4b60-a08d-d5cb7cc3dcb4 None admin] RBAC: Adding query filter params (group.id=dc48be0421c84e64b849cbd6e2cadae0, role.id=284c6314b4d3492085e397a87b0e3b51, scope.project.id=602fa21468b24207a8f98e92cd2c99ce) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:04:35.277217 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff43e352-1805-4b60-a08d-d5cb7cc3dcb4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:35.278795 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff43e352-1805-4b60-a08d-d5cb7cc3dcb4 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:35.285009 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 235/455] 10.222.0.136 () {56 vars in 1381 bytes} [Thu Jul 14 17:04:35 2022] GET /identity/v3/role_assignments?group.id=dc48be0421c84e64b849cbd6e2cadae0&scope.project.id=602fa21468b24207a8f98e92cd2c99ce&role.id=284c6314b4d3492085e397a87b0e3b51 => generated 613 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:04:37.870435 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb182ac4-03b4-424e-bdd2-612996c29b2d None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:37.870980 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb182ac4-03b4-424e-bdd2-612996c29b2d None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:37.870980 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb182ac4-03b4-424e-bdd2-612996c29b2d None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:37.872627 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 221/456] 10.222.0.136 () {54 vars in 931 bytes} [Thu Jul 14 17:04:37 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:04:37.878006 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81ad83e-def3-48f4-8a1f-0c42cd60d7e8 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:37.878840 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81ad83e-def3-48f4-8a1f-0c42cd60d7e8 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:37.880124 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81ad83e-def3-48f4-8a1f-0c42cd60d7e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:37.902231 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-d81ad83e-def3-48f4-8a1f-0c42cd60d7e8 None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:04:37.903775 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-d81ad83e-def3-48f4-8a1f-0c42cd60d7e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:04:37.981244 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 236/457] 10.222.0.136 () {58 vars in 1028 bytes} [Thu Jul 14 17:04:37 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 17:04:38.008297 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb182ac4-03b4-424e-bdd2-612996c29b2d None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:38.064399 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:38.099179 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a28e79c-8d3d-431c-aabb-4e80e855642a None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:38.099599 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a28e79c-8d3d-431c-aabb-4e80e855642a None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:38.099856 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a28e79c-8d3d-431c-aabb-4e80e855642a None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:38.101434 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 237/458] 10.222.0.136 () {54 vars in 931 bytes} [Thu Jul 14 17:04:38 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 14 17:04:38.107263 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f7cafb-5249-4651-8565-887226d77f9c None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:38.107705 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f7cafb-5249-4651-8565-887226d77f9c None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:38.108082 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f7cafb-5249-4651-8565-887226d77f9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:38.121475 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb182ac4-03b4-424e-bdd2-612996c29b2d None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:38.132754 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-a0f7cafb-5249-4651-8565-887226d77f9c None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:04:38.134234 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-a0f7cafb-5249-4651-8565-887226d77f9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:04:38.159064 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051f6eb0-9bcc-4e4b-84a7-126b272c4b79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:38.159861 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051f6eb0-9bcc-4e4b-84a7-126b272c4b79 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:38.160146 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051f6eb0-9bcc-4e4b-84a7-126b272c4b79 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:38.160423 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051f6eb0-9bcc-4e4b-84a7-126b272c4b79 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:38.172282 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051f6eb0-9bcc-4e4b-84a7-126b272c4b79 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:38.173805 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051f6eb0-9bcc-4e4b-84a7-126b272c4b79 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:38.197150 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-051f6eb0-9bcc-4e4b-84a7-126b272c4b79 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:04:38.197150 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:04:38.197150 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:04:38.197150 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:04:38.197150 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:04:38.197150 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:04:38.197150 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:04:38.197150 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:04:38.197150 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:04:38.197150 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:04:38.197150 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:04:38.197150 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:04:38.197150 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 17:04:38.197150 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 17:04:38.197150 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 17:04:38.198217 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 17:04:38.198217 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:04:38.198217 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:04:38.198217 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:04:38.198217 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:04:38.198217 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:04:38.198217 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:04:38.198217 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:04:38.198217 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Jul 14 17:04:38.198217 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:04:38.198217 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:04:38.198217 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:04:38.198217 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:04:38.198217 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:04:38.198217 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:04:38.198217 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:04:38.198217 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:04:38.199262 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 17:04:38.199262 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 17:04:38.199262 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:04:38.199262 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Jul 14 17:04:38.199262 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 222/459] 10.222.0.136 () {56 vars in 1113 bytes} [Thu Jul 14 17:04:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:04:38.200060 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89ec558-7e04-4025-bd91-e26eb57b9faa None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:38.200351 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89ec558-7e04-4025-bd91-e26eb57b9faa None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:38.200703 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89ec558-7e04-4025-bd91-e26eb57b9faa None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:38.206129 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 223/460] 10.222.0.136 () {54 vars in 931 bytes} [Thu Jul 14 17:04:38 2022] GET /identity => generated 271 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:04:38.207076 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89ec558-7e04-4025-bd91-e26eb57b9faa None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:38.225726 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 238/461] 10.222.0.136 () {58 vars in 1028 bytes} [Thu Jul 14 17:04:38 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 17:04:38.225726 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78ae15b-32e0-4a67-8f14-43a90d566174 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:38.225726 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78ae15b-32e0-4a67-8f14-43a90d566174 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:38.225726 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78ae15b-32e0-4a67-8f14-43a90d566174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:38.250013 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-f78ae15b-32e0-4a67-8f14-43a90d566174 None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:04:38.251536 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-f78ae15b-32e0-4a67-8f14-43a90d566174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:04:38.261477 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:38.318701 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:38.323170 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89ec558-7e04-4025-bd91-e26eb57b9faa None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:38.334234 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 239/462] 10.222.0.136 () {58 vars in 1028 bytes} [Thu Jul 14 17:04:38 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 17:04:38.338537 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78ae15b-32e0-4a67-8f14-43a90d566174 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:38.370702 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff76beaf-fa6b-452a-a176-0ceb36776a6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:38.371362 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff76beaf-fa6b-452a-a176-0ceb36776a6c None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:38.371701 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff76beaf-fa6b-452a-a176-0ceb36776a6c None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:38.371920 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff76beaf-fa6b-452a-a176-0ceb36776a6c None admin] PATH_INFO: `/v3/domains` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:38.372636 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff76beaf-fa6b-452a-a176-0ceb36776a6c None admin] RBAC: Adding query filter params (name=Default) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:04:38.372943 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff76beaf-fa6b-452a-a176-0ceb36776a6c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:38.374353 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff76beaf-fa6b-452a-a176-0ceb36776a6c None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:38.393402 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 224/463] 10.222.0.136 () {56 vars in 1114 bytes} [Thu Jul 14 17:04:38 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:04:38.394840 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff76beaf-fa6b-452a-a176-0ceb36776a6c None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:38.459318 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78ae15b-32e0-4a67-8f14-43a90d566174 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:38.501518 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c92e23-7021-42fc-8047-aeb33a36bb25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:38.502340 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c92e23-7021-42fc-8047-aeb33a36bb25 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:38.502619 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c92e23-7021-42fc-8047-aeb33a36bb25 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:38.502890 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c92e23-7021-42fc-8047-aeb33a36bb25 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:38.512305 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff76beaf-fa6b-452a-a176-0ceb36776a6c None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:38.513779 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c92e23-7021-42fc-8047-aeb33a36bb25 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:38.515230 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c92e23-7021-42fc-8047-aeb33a36bb25 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:38.516968 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:38.534676 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-27c92e23-7021-42fc-8047-aeb33a36bb25 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:04:38.534676 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:04:38.534676 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:04:38.534676 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:04:38.534676 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:04:38.534676 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:04:38.534676 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:04:38.534676 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:04:38.534676 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:04:38.534676 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:04:38.534676 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:04:38.534676 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:04:38.534676 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 17:04:38.534676 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 17:04:38.534676 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 17:04:38.535566 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 17:04:38.535566 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:04:38.535566 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:04:38.535566 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:04:38.535566 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:04:38.535566 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:04:38.535566 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:04:38.535566 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:04:38.535566 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Jul 14 17:04:38.535566 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:04:38.535566 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:04:38.535566 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:04:38.535566 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:04:38.535566 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:04:38.535566 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:04:38.535566 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:04:38.535566 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:04:38.536989 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 17:04:38.536989 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 17:04:38.536989 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:04:38.536989 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Jul 14 17:04:38.536989 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 240/464] 10.222.0.136 () {56 vars in 1113 bytes} [Thu Jul 14 17:04:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:04:38.537499 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c92e23-7021-42fc-8047-aeb33a36bb25 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:38.551328 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d9f077-7383-4e64-911b-0d300898fece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:38.552117 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d9f077-7383-4e64-911b-0d300898fece None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:38.552408 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d9f077-7383-4e64-911b-0d300898fece None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:38.552690 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d9f077-7383-4e64-911b-0d300898fece None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:38.562695 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d9f077-7383-4e64-911b-0d300898fece None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:38.564156 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d9f077-7383-4e64-911b-0d300898fece None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:38.581295 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-82d9f077-7383-4e64-911b-0d300898fece None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:04:38.581295 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:04:38.581295 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:04:38.581295 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:04:38.581295 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:04:38.581295 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:04:38.581295 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:04:38.581295 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:04:38.581295 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:04:38.581295 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:04:38.581295 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:04:38.581295 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:04:38.581295 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 17:04:38.581295 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 17:04:38.581295 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 17:04:38.582185 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 17:04:38.582185 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:04:38.582185 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:04:38.582185 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:04:38.582185 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:04:38.582185 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:04:38.582185 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:04:38.582185 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:04:38.582185 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Jul 14 17:04:38.582185 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:04:38.582185 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:04:38.582185 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:04:38.582185 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:04:38.582185 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:04:38.582185 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:04:38.582185 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:04:38.582185 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:04:38.583598 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 17:04:38.583598 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 17:04:38.583598 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:04:38.583598 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Jul 14 17:04:38.583598 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 225/465] 10.222.0.136 () {56 vars in 1113 bytes} [Thu Jul 14 17:04:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:04:38.584554 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9028b0-6c77-43d7-85d3-f51c991a34c2 None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:38.584847 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9028b0-6c77-43d7-85d3-f51c991a34c2 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:38.585128 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9028b0-6c77-43d7-85d3-f51c991a34c2 None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:38.586412 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 226/466] 10.222.0.136 () {54 vars in 931 bytes} [Thu Jul 14 17:04:38 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:04:38.587096 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9028b0-6c77-43d7-85d3-f51c991a34c2 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:38.602289 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:38.646207 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c92e23-7021-42fc-8047-aeb33a36bb25 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:38.681349 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df61b4d-c505-4806-836b-5b65216c9b90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:38.682073 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df61b4d-c505-4806-836b-5b65216c9b90 None admin] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:38.682368 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df61b4d-c505-4806-836b-5b65216c9b90 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:38.682650 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df61b4d-c505-4806-836b-5b65216c9b90 None admin] PATH_INFO: `/v3/users` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:38.683353 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df61b4d-c505-4806-836b-5b65216c9b90 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:38.684792 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df61b4d-c505-4806-836b-5b65216c9b90 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:38.690087 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9028b0-6c77-43d7-85d3-f51c991a34c2 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:38.704543 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 241/467] 10.222.0.136 () {60 vars in 1137 bytes} [Thu Jul 14 17:04:38 2022] POST /identity/v3/users => generated 247 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 17:04:38.705348 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df61b4d-c505-4806-836b-5b65216c9b90 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:38.730999 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36360933-6bdc-4b3d-87ab-9b516f115a25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:38.731688 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36360933-6bdc-4b3d-87ab-9b516f115a25 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:38.731974 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36360933-6bdc-4b3d-87ab-9b516f115a25 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:38.732250 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36360933-6bdc-4b3d-87ab-9b516f115a25 None admin] PATH_INFO: `/v3/domains` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:38.732994 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36360933-6bdc-4b3d-87ab-9b516f115a25 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:04:38.733310 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36360933-6bdc-4b3d-87ab-9b516f115a25 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:38.734798 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36360933-6bdc-4b3d-87ab-9b516f115a25 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:38.748065 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 227/468] 10.222.0.136 () {56 vars in 1114 bytes} [Thu Jul 14 17:04:38 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:04:38.749496 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f056c703-857a-40c7-81cd-24986fc9d3f6 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:38.749824 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f056c703-857a-40c7-81cd-24986fc9d3f6 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:38.750106 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f056c703-857a-40c7-81cd-24986fc9d3f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:38.769893 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-f056c703-857a-40c7-81cd-24986fc9d3f6 None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:04:38.771189 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-f056c703-857a-40c7-81cd-24986fc9d3f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:04:38.774420 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:38.843989 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df61b4d-c505-4806-836b-5b65216c9b90 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:38.846446 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 228/469] 10.222.0.136 () {58 vars in 1028 bytes} [Thu Jul 14 17:04:38 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 17:04:38.847358 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f056c703-857a-40c7-81cd-24986fc9d3f6 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:38.850694 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:38.895154 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bddedc1-a831-46f2-bae6-f35f764dd941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:38.896744 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bddedc1-a831-46f2-bae6-f35f764dd941 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:38.897295 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bddedc1-a831-46f2-bae6-f35f764dd941 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:38.897601 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bddedc1-a831-46f2-bae6-f35f764dd941 None admin] PATH_INFO: `/v3/domains` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:38.898355 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bddedc1-a831-46f2-bae6-f35f764dd941 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:04:38.898663 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bddedc1-a831-46f2-bae6-f35f764dd941 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:38.900037 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bddedc1-a831-46f2-bae6-f35f764dd941 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:38.914628 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 242/470] 10.222.0.136 () {56 vars in 1114 bytes} [Thu Jul 14 17:04:38 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:04:38.915315 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bddedc1-a831-46f2-bae6-f35f764dd941 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:38.983370 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f056c703-857a-40c7-81cd-24986fc9d3f6 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:39.020797 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431e848b-7426-42a4-a2dd-a4d2c45dd2ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:39.021481 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431e848b-7426-42a4-a2dd-a4d2c45dd2ad None admin] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:39.021810 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431e848b-7426-42a4-a2dd-a4d2c45dd2ad None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:39.022092 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431e848b-7426-42a4-a2dd-a4d2c45dd2ad None admin] PATH_INFO: `/v3/users` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:39.022789 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431e848b-7426-42a4-a2dd-a4d2c45dd2ad None admin] RBAC: Authorizing `identity:create_user()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:39.024219 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431e848b-7426-42a4-a2dd-a4d2c45dd2ad None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:39.033794 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bddedc1-a831-46f2-bae6-f35f764dd941 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:39.046562 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 229/471] 10.222.0.136 () {60 vars in 1137 bytes} [Thu Jul 14 17:04:38 2022] POST /identity/v3/users => generated 249 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 17:04:39.047651 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431e848b-7426-42a4-a2dd-a4d2c45dd2ad None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:39.048897 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:39.078134 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a511d83-1ddf-4736-82d9-808084d2bc68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:39.078966 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a511d83-1ddf-4736-82d9-808084d2bc68 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:39.079255 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a511d83-1ddf-4736-82d9-808084d2bc68 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:39.079535 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a511d83-1ddf-4736-82d9-808084d2bc68 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:39.093010 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a511d83-1ddf-4736-82d9-808084d2bc68 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:39.094650 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a511d83-1ddf-4736-82d9-808084d2bc68 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:39.116572 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-6a511d83-1ddf-4736-82d9-808084d2bc68 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:04:39.116572 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:04:39.116572 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:04:39.116572 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:04:39.116572 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:04:39.116572 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:04:39.116572 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:04:39.116572 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:04:39.116572 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:04:39.116572 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:04:39.116572 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:04:39.116572 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:04:39.116572 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 17:04:39.116572 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 17:04:39.116572 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 17:04:39.117491 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 17:04:39.117491 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:04:39.117491 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:04:39.117491 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:04:39.117491 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:04:39.117491 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:04:39.117491 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:04:39.117491 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:04:39.117491 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Jul 14 17:04:39.117491 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:04:39.117491 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:04:39.117491 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:04:39.117491 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:04:39.117491 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:04:39.117491 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:04:39.117491 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:04:39.117491 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:04:39.118521 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 17:04:39.118521 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 17:04:39.118521 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:04:39.118521 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Jul 14 17:04:39.118521 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 243/472] 10.222.0.136 () {56 vars in 1113 bytes} [Thu Jul 14 17:04:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:04:39.125056 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a511d83-1ddf-4736-82d9-808084d2bc68 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:39.140978 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:39.209452 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431e848b-7426-42a4-a2dd-a4d2c45dd2ad None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:39.258313 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24e7d5a-98a7-4406-a868-32721c09b9eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:39.259844 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24e7d5a-98a7-4406-a868-32721c09b9eb None admin] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:39.260282 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24e7d5a-98a7-4406-a868-32721c09b9eb None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:39.260578 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24e7d5a-98a7-4406-a868-32721c09b9eb None admin] PATH_INFO: `/v3/users` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:39.261350 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24e7d5a-98a7-4406-a868-32721c09b9eb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:39.263017 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24e7d5a-98a7-4406-a868-32721c09b9eb None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:39.269088 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a511d83-1ddf-4736-82d9-808084d2bc68 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:39.290775 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 230/473] 10.222.0.136 () {60 vars in 1137 bytes} [Thu Jul 14 17:04:39 2022] POST /identity/v3/users => generated 249 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 17:04:39.311813 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2fd096-670b-446e-b2b8-03e03bda1454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:39.312507 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2fd096-670b-446e-b2b8-03e03bda1454 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:39.312791 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2fd096-670b-446e-b2b8-03e03bda1454 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:39.313670 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2fd096-670b-446e-b2b8-03e03bda1454 None admin] PATH_INFO: `/v3/domains` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:39.313845 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2fd096-670b-446e-b2b8-03e03bda1454 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:04:39.314152 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2fd096-670b-446e-b2b8-03e03bda1454 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:39.315558 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2fd096-670b-446e-b2b8-03e03bda1454 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:39.330430 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 244/474] 10.222.0.136 () {56 vars in 1114 bytes} [Thu Jul 14 17:04:39 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 17:04:39.336398 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24e7d5a-98a7-4406-a868-32721c09b9eb None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:39.461726 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24e7d5a-98a7-4406-a868-32721c09b9eb None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:39.477467 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:39.509071 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39047be8-1091-47c2-8b76-4bd1fc79472d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:39.509797 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39047be8-1091-47c2-8b76-4bd1fc79472d None admin] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:39.510082 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39047be8-1091-47c2-8b76-4bd1fc79472d None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:39.510366 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39047be8-1091-47c2-8b76-4bd1fc79472d None admin] PATH_INFO: `/v3/users` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:39.511092 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39047be8-1091-47c2-8b76-4bd1fc79472d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:39.512546 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39047be8-1091-47c2-8b76-4bd1fc79472d None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:39.534693 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 231/475] 10.222.0.136 () {60 vars in 1137 bytes} [Thu Jul 14 17:04:39 2022] POST /identity/v3/users => generated 250 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 17:04:41.213402 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b80afc-91ce-42ed-b406-cd85f7da632e None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:41.213861 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b80afc-91ce-42ed-b406-cd85f7da632e None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:41.214047 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b80afc-91ce-42ed-b406-cd85f7da632e None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:41.215497 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 245/476] 10.222.0.136 () {54 vars in 931 bytes} [Thu Jul 14 17:04:41 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:04:41.220932 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aee529-9886-4c41-8984-5bb28617f9e9 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:41.221810 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aee529-9886-4c41-8984-5bb28617f9e9 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:41.222303 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aee529-9886-4c41-8984-5bb28617f9e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:41.240909 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-d4aee529-9886-4c41-8984-5bb28617f9e9 None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:04:41.242482 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-d4aee529-9886-4c41-8984-5bb28617f9e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:04:41.320835 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 232/477] 10.222.0.136 () {58 vars in 1028 bytes} [Thu Jul 14 17:04:41 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 17:04:41.347091 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b80afc-91ce-42ed-b406-cd85f7da632e None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:41.375087 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:41.465428 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b80afc-91ce-42ed-b406-cd85f7da632e None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:41.506639 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb78ae97-0e06-4251-9b3a-29a753e7a0a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:41.507814 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb78ae97-0e06-4251-9b3a-29a753e7a0a8 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:41.508324 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb78ae97-0e06-4251-9b3a-29a753e7a0a8 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:41.508802 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb78ae97-0e06-4251-9b3a-29a753e7a0a8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:41.522216 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb78ae97-0e06-4251-9b3a-29a753e7a0a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 17:04:41.530735 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-eb78ae97-0e06-4251-9b3a-29a753e7a0a8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 17:04:41.530735 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:04:41.530735 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:04:41.530735 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:04:41.530735 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:04:41.530735 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:04:41.530735 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:04:41.530735 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:04:41.530735 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:04:41.530735 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:04:41.530735 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:04:41.530735 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:04:41.530735 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 17:04:41.530735 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 17:04:41.530735 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 17:04:41.530735 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 17:04:41.531699 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 17:04:41.531699 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 17:04:41.531699 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 17:04:41.531699 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 17:04:41.531699 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:04:41.531699 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:04:41.531699 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:04:41.531699 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:04:41.531699 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:04:41.531699 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:04:41.531699 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:04:41.531699 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Jul 14 17:04:41.531699 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:04:41.531699 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:04:41.531699 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:04:41.531699 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:04:41.532484 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:04:41.532484 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:04:41.532484 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:04:41.532484 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:04:41.532484 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 17:04:41.532484 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 17:04:41.532484 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 17:04:41.532484 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 17:04:41.532484 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 17:04:41.532484 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 17:04:41.532484 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 17:04:41.532484 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Jul 14 17:04:41.535393 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 246/478] 10.222.0.136 () {56 vars in 1107 bytes} [Thu Jul 14 17:04:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:04:41.542134 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4aee529-9886-4c41-8984-5bb28617f9e9 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:41.580037 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720283ec-e484-4e62-b56f-c99f6eedd158 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:41.580341 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720283ec-e484-4e62-b56f-c99f6eedd158 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:41.580598 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720283ec-e484-4e62-b56f-c99f6eedd158 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:41.582255 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 247/479] 10.222.0.136 () {54 vars in 931 bytes} [Thu Jul 14 17:04:41 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 14 17:04:41.587393 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79efd46-bb2f-4c1b-b3a4-27a208bd0408 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:41.587681 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79efd46-bb2f-4c1b-b3a4-27a208bd0408 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:41.587964 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79efd46-bb2f-4c1b-b3a4-27a208bd0408 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:41.607775 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-b79efd46-bb2f-4c1b-b3a4-27a208bd0408 None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:04:41.609270 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-b79efd46-bb2f-4c1b-b3a4-27a208bd0408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:04:41.668527 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:41.673262 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4aee529-9886-4c41-8984-5bb28617f9e9 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:41.698127 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 248/480] 10.222.0.136 () {58 vars in 1028 bytes} [Thu Jul 14 17:04:41 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 17:04:41.699550 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bfd455-ec17-429a-b3f6-710b8fa11676 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:41.699840 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bfd455-ec17-429a-b3f6-710b8fa11676 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:41.700120 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bfd455-ec17-429a-b3f6-710b8fa11676 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:41.705271 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 249/481] 10.222.0.136 () {54 vars in 931 bytes} [Thu Jul 14 17:04:41 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:04:41.706508 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47c5fad-60cc-4b57-80e5-db637530dec2 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:41.706811 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47c5fad-60cc-4b57-80e5-db637530dec2 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:41.707095 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47c5fad-60cc-4b57-80e5-db637530dec2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:41.719667 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f8b73f-9c6c-4393-8288-a5991eca75f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:41.720282 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f8b73f-9c6c-4393-8288-a5991eca75f3 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:41.720688 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f8b73f-9c6c-4393-8288-a5991eca75f3 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:41.720949 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f8b73f-9c6c-4393-8288-a5991eca75f3 None admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:41.721640 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f8b73f-9c6c-4393-8288-a5991eca75f3 None admin] RBAC: Adding query filter params (name=service) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:04:41.721958 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f8b73f-9c6c-4393-8288-a5991eca75f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:41.723618 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f8b73f-9c6c-4393-8288-a5991eca75f3 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:41.724871 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-b47c5fad-60cc-4b57-80e5-db637530dec2 None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:04:41.726171 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-b47c5fad-60cc-4b57-80e5-db637530dec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:04:41.732826 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 233/482] 10.222.0.136 () {56 vars in 1108 bytes} [Thu Jul 14 17:04:41 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:04:41.734906 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:41.738072 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f8b73f-9c6c-4393-8288-a5991eca75f3 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:41.816697 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 250/483] 10.222.0.136 () {58 vars in 1028 bytes} [Thu Jul 14 17:04:41 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 17:04:41.816697 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47c5fad-60cc-4b57-80e5-db637530dec2 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:41.856750 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f8b73f-9c6c-4393-8288-a5991eca75f3 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:41.892830 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1613d85d-6457-4507-9d2a-16e32a470808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:41.893768 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1613d85d-6457-4507-9d2a-16e32a470808 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:41.894057 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1613d85d-6457-4507-9d2a-16e32a470808 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:41.894334 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1613d85d-6457-4507-9d2a-16e32a470808 None admin] PATH_INFO: `/v3/roles/service` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:41.904910 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1613d85d-6457-4507-9d2a-16e32a470808 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 17:04:41.913219 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-1613d85d-6457-4507-9d2a-16e32a470808 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 17:04:41.913219 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:04:41.913219 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:04:41.913219 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:04:41.913219 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:04:41.913219 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:04:41.913219 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:04:41.913219 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:04:41.913219 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:04:41.913219 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:04:41.913219 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:04:41.913219 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:04:41.913219 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 17:04:41.913219 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 17:04:41.913219 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 17:04:41.913219 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 17:04:41.914182 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 17:04:41.914182 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 17:04:41.914182 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 17:04:41.914182 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 17:04:41.914182 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:04:41.914182 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:04:41.914182 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:04:41.914182 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:04:41.914182 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:04:41.914182 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:04:41.914182 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:04:41.914182 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Jul 14 17:04:41.914182 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:04:41.914182 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:04:41.914182 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:04:41.914182 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:04:41.914992 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:04:41.914992 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:04:41.914992 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:04:41.914992 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:04:41.914992 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 17:04:41.914992 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 17:04:41.914992 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 17:04:41.914992 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 17:04:41.914992 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 17:04:41.914992 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 17:04:41.914992 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 17:04:41.914992 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Jul 14 17:04:41.919505 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 234/484] 10.222.0.136 () {56 vars in 1107 bytes} [Thu Jul 14 17:04:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:04:41.920244 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1613d85d-6457-4507-9d2a-16e32a470808 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:41.929990 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47c5fad-60cc-4b57-80e5-db637530dec2 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:41.947157 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:41.967043 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9819d44-4d5f-4fe5-8941-3bb55fdfae9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:41.967830 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9819d44-4d5f-4fe5-8941-3bb55fdfae9b None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:41.968117 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9819d44-4d5f-4fe5-8941-3bb55fdfae9b None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:41.968397 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9819d44-4d5f-4fe5-8941-3bb55fdfae9b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:41.979043 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9819d44-4d5f-4fe5-8941-3bb55fdfae9b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:41.980438 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9819d44-4d5f-4fe5-8941-3bb55fdfae9b None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:41.982413 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:41.999875 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-f9819d44-4d5f-4fe5-8941-3bb55fdfae9b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:04:41.999875 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:04:41.999875 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:04:41.999875 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:04:41.999875 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:04:41.999875 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:04:41.999875 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:04:41.999875 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:04:41.999875 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:04:41.999875 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:04:41.999875 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:04:41.999875 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:04:41.999875 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 17:04:41.999875 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 17:04:41.999875 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 17:04:42.000749 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 17:04:42.000749 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:04:42.000749 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:04:42.000749 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:04:42.000749 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:04:42.000749 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:04:42.000749 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:04:42.000749 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:04:42.000749 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Jul 14 17:04:42.000749 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:04:42.000749 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:04:42.000749 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:04:42.000749 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:04:42.000749 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:04:42.000749 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:04:42.000749 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:04:42.000749 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:04:42.001724 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 17:04:42.001724 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 17:04:42.001724 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:04:42.001724 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Jul 14 17:04:42.001724 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 251/485] 10.222.0.136 () {56 vars in 1113 bytes} [Thu Jul 14 17:04:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:04:42.001999 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9819d44-4d5f-4fe5-8941-3bb55fdfae9b None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:42.024574 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1613d85d-6457-4507-9d2a-16e32a470808 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:42.059654 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763863bf-2b83-4c69-acc3-7cdae17b3894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:42.060570 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763863bf-2b83-4c69-acc3-7cdae17b3894 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:42.060900 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763863bf-2b83-4c69-acc3-7cdae17b3894 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:42.061253 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763863bf-2b83-4c69-acc3-7cdae17b3894 None admin] PATH_INFO: `/v3/roles/service` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:42.072727 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763863bf-2b83-4c69-acc3-7cdae17b3894 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 17:04:42.080446 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-763863bf-2b83-4c69-acc3-7cdae17b3894 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 17:04:42.080446 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:04:42.080446 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:04:42.080446 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:04:42.080446 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:04:42.080446 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:04:42.080446 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:04:42.080446 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:04:42.080446 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:04:42.080446 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:04:42.080446 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:04:42.080446 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:04:42.080446 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 17:04:42.080446 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 17:04:42.080446 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 17:04:42.080446 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 17:04:42.081471 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 17:04:42.081471 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 17:04:42.081471 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 17:04:42.081471 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 17:04:42.081471 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:04:42.081471 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:04:42.081471 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:04:42.081471 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:04:42.081471 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:04:42.081471 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:04:42.081471 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:04:42.081471 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Jul 14 17:04:42.081471 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:04:42.081471 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:04:42.081471 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:04:42.081471 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:04:42.082358 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:04:42.082358 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:04:42.082358 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:04:42.082358 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:04:42.082358 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 17:04:42.082358 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 17:04:42.082358 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 17:04:42.082358 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 17:04:42.082358 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 17:04:42.082358 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 17:04:42.082358 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 17:04:42.082358 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Jul 14 17:04:42.082358 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 235/486] 10.222.0.136 () {56 vars in 1107 bytes} [Thu Jul 14 17:04:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:04:42.083620 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1c9db3-793c-416e-8ecc-79f2790cb6fa None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:42.084040 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1c9db3-793c-416e-8ecc-79f2790cb6fa None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:42.084198 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1c9db3-793c-416e-8ecc-79f2790cb6fa None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:42.085672 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 236/487] 10.222.0.136 () {54 vars in 931 bytes} [Thu Jul 14 17:04:42 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:04:42.090333 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1c9db3-793c-416e-8ecc-79f2790cb6fa None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:42.112680 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9819d44-4d5f-4fe5-8941-3bb55fdfae9b None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:42.149466 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122fd8a2-f126-4750-8a0f-23d13b72db75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:42.150166 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122fd8a2-f126-4750-8a0f-23d13b72db75 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:42.150450 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122fd8a2-f126-4750-8a0f-23d13b72db75 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:42.150731 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122fd8a2-f126-4750-8a0f-23d13b72db75 None admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:42.151475 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122fd8a2-f126-4750-8a0f-23d13b72db75 None admin] RBAC: Adding query filter params (name=service) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:04:42.151783 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122fd8a2-f126-4750-8a0f-23d13b72db75 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:42.153138 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122fd8a2-f126-4750-8a0f-23d13b72db75 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:42.163181 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 252/488] 10.222.0.136 () {56 vars in 1108 bytes} [Thu Jul 14 17:04:42 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:04:42.163985 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122fd8a2-f126-4750-8a0f-23d13b72db75 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:42.175139 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:42.198572 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1c9db3-793c-416e-8ecc-79f2790cb6fa None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:42.224918 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:42.233918 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331278b2-f7ad-4e80-8f5e-5f34fa9a588c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:42.234526 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331278b2-f7ad-4e80-8f5e-5f34fa9a588c None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:42.234812 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331278b2-f7ad-4e80-8f5e-5f34fa9a588c None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:42.235092 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331278b2-f7ad-4e80-8f5e-5f34fa9a588c None admin] PATH_INFO: `/v3/domains` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:42.235815 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331278b2-f7ad-4e80-8f5e-5f34fa9a588c None admin] RBAC: Adding query filter params (name=Default) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:04:42.236126 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331278b2-f7ad-4e80-8f5e-5f34fa9a588c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:42.237517 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331278b2-f7ad-4e80-8f5e-5f34fa9a588c None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:42.250415 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 237/489] 10.222.0.136 () {56 vars in 1114 bytes} [Thu Jul 14 17:04:42 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:04:42.251563 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b87838-8516-43bf-8664-ec46c7dcc1ef None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:42.251853 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b87838-8516-43bf-8664-ec46c7dcc1ef None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:42.252134 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b87838-8516-43bf-8664-ec46c7dcc1ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:42.268614 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-d7b87838-8516-43bf-8664-ec46c7dcc1ef None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:04:42.269848 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-d7b87838-8516-43bf-8664-ec46c7dcc1ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:04:42.274036 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122fd8a2-f126-4750-8a0f-23d13b72db75 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:42.308580 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb68a9e-3990-4d76-b5b0-ccfb6d383ee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:42.309251 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb68a9e-3990-4d76-b5b0-ccfb6d383ee7 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:42.309555 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb68a9e-3990-4d76-b5b0-ccfb6d383ee7 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:42.309856 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb68a9e-3990-4d76-b5b0-ccfb6d383ee7 None admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:42.310606 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb68a9e-3990-4d76-b5b0-ccfb6d383ee7 None admin] RBAC: Adding query filter params (name=service) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:04:42.310931 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb68a9e-3990-4d76-b5b0-ccfb6d383ee7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:42.312273 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb68a9e-3990-4d76-b5b0-ccfb6d383ee7 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:42.321076 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 253/490] 10.222.0.136 () {56 vars in 1108 bytes} [Thu Jul 14 17:04:42 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:04:42.321913 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb68a9e-3990-4d76-b5b0-ccfb6d383ee7 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:42.340247 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 238/491] 10.222.0.136 () {58 vars in 1028 bytes} [Thu Jul 14 17:04:42 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 17:04:42.341173 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b87838-8516-43bf-8664-ec46c7dcc1ef None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:42.423300 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:42.425843 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb68a9e-3990-4d76-b5b0-ccfb6d383ee7 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:42.443648 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:42.452512 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b87838-8516-43bf-8664-ec46c7dcc1ef None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:42.461153 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d21b31-0cef-49ec-beb7-6156d13322db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:42.461980 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d21b31-0cef-49ec-beb7-6156d13322db None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:42.462265 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d21b31-0cef-49ec-beb7-6156d13322db None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:42.462537 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d21b31-0cef-49ec-beb7-6156d13322db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:42.474201 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d21b31-0cef-49ec-beb7-6156d13322db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:42.475663 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d21b31-0cef-49ec-beb7-6156d13322db None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:42.487414 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19af6af9-e161-45db-bcdd-f6185fe98be3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:42.488150 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19af6af9-e161-45db-bcdd-f6185fe98be3 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:42.488443 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19af6af9-e161-45db-bcdd-f6185fe98be3 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:42.488827 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19af6af9-e161-45db-bcdd-f6185fe98be3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:42.492759 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-b1d21b31-0cef-49ec-beb7-6156d13322db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:04:42.492759 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:04:42.492759 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:04:42.492759 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:04:42.492759 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:04:42.492759 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:04:42.492759 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:04:42.492759 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:04:42.492759 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:04:42.492759 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:04:42.492759 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:04:42.492759 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:04:42.492759 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 17:04:42.492759 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 17:04:42.492759 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 17:04:42.493628 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 17:04:42.493628 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:04:42.493628 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:04:42.493628 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:04:42.493628 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:04:42.493628 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:04:42.493628 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:04:42.493628 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:04:42.493628 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Jul 14 17:04:42.493628 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:04:42.493628 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:04:42.493628 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:04:42.493628 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:04:42.493628 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:04:42.493628 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:04:42.493628 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:04:42.493628 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:04:42.494500 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 17:04:42.494500 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 17:04:42.494500 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:04:42.494500 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Jul 14 17:04:42.494500 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 254/492] 10.222.0.136 () {56 vars in 1113 bytes} [Thu Jul 14 17:04:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:04:42.494781 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d21b31-0cef-49ec-beb7-6156d13322db None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:42.496281 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19af6af9-e161-45db-bcdd-f6185fe98be3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:42.497776 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19af6af9-e161-45db-bcdd-f6185fe98be3 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:42.514690 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-19af6af9-e161-45db-bcdd-f6185fe98be3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 14 17:04:42.514690 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:04:42.514690 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:04:42.514690 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:04:42.514690 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:04:42.514690 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:04:42.514690 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:04:42.514690 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:04:42.514690 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:04:42.514690 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:04:42.514690 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:04:42.514690 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:04:42.514690 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 17:04:42.514690 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 17:04:42.514690 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 17:04:42.514690 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 17:04:42.515755 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:04:42.515755 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:04:42.515755 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 17:04:42.515755 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 17:04:42.515755 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 17:04:42.515755 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 17:04:42.515755 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:04:42.515755 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:04:42.515755 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:04:42.515755 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:04:42.515755 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:04:42.515755 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Jul 14 17:04:42.515755 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:04:42.515755 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:04:42.515755 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:04:42.515755 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:04:42.515755 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:04:42.515755 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:04:42.516660 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:04:42.516660 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:04:42.516660 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 17:04:42.516660 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 17:04:42.516660 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 17:04:42.516660 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 17:04:42.516660 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 17:04:42.516660 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 17:04:42.516660 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 14 17:04:42.516660 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Jul 14 17:04:42.516660 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 239/493] 10.222.0.136 () {56 vars in 1098 bytes} [Thu Jul 14 17:04:42 2022] GET /identity/v3/users/nova => generated 82 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:04:42.517238 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19af6af9-e161-45db-bcdd-f6185fe98be3 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:42.607596 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d21b31-0cef-49ec-beb7-6156d13322db None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:42.622099 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19af6af9-e161-45db-bcdd-f6185fe98be3 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:42.642230 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8466f0-019e-480f-b376-9d53ae58f592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:42.643026 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8466f0-019e-480f-b376-9d53ae58f592 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:42.643313 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8466f0-019e-480f-b376-9d53ae58f592 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:42.643601 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8466f0-019e-480f-b376-9d53ae58f592 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:42.652288 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:42.655399 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8466f0-019e-480f-b376-9d53ae58f592 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:42.656842 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8466f0-019e-480f-b376-9d53ae58f592 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:42.657615 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2f4efc-90b5-457f-8464-af28afa7ec12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:42.658410 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2f4efc-90b5-457f-8464-af28afa7ec12 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:42.658698 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2f4efc-90b5-457f-8464-af28afa7ec12 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:42.658973 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2f4efc-90b5-457f-8464-af28afa7ec12 None admin] PATH_INFO: `/v3/roles/service` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:42.669314 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2f4efc-90b5-457f-8464-af28afa7ec12 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 17:04:42.675219 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-be8466f0-019e-480f-b376-9d53ae58f592 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:04:42.675219 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:04:42.675219 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:04:42.675219 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:04:42.675219 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:04:42.675219 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:04:42.675219 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:04:42.675219 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:04:42.675219 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:04:42.675219 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:04:42.675219 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:04:42.675219 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:04:42.675219 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 17:04:42.675219 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 17:04:42.675219 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 17:04:42.676383 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 17:04:42.676383 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:04:42.676383 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:04:42.676383 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:04:42.676383 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:04:42.676383 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:04:42.676383 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:04:42.676383 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:04:42.676383 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Jul 14 17:04:42.676383 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:04:42.676383 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:04:42.676383 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:04:42.676383 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:04:42.676383 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:04:42.676383 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:04:42.676383 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:04:42.676383 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:04:42.678119 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 17:04:42.678119 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 17:04:42.678119 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:04:42.678119 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Jul 14 17:04:42.678119 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 255/494] 10.222.0.136 () {56 vars in 1113 bytes} [Thu Jul 14 17:04:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:04:42.678708 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-fb2f4efc-90b5-457f-8464-af28afa7ec12 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 17:04:42.678708 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:04:42.678708 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:04:42.678708 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:04:42.678708 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:04:42.678708 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:04:42.678708 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:04:42.678708 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:04:42.678708 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:04:42.678708 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:04:42.678708 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:04:42.678708 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:04:42.678708 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 17:04:42.678708 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 17:04:42.678708 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 17:04:42.678708 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 17:04:42.680795 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 17:04:42.680795 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 17:04:42.680795 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 17:04:42.680795 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 17:04:42.680795 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:04:42.680795 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:04:42.680795 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:04:42.680795 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:04:42.680795 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:04:42.680795 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:04:42.680795 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:04:42.680795 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Jul 14 17:04:42.680795 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:04:42.680795 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:04:42.680795 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:04:42.680795 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:04:42.682953 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:04:42.682953 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:04:42.682953 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:04:42.682953 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:04:42.682953 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 17:04:42.682953 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 17:04:42.682953 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 17:04:42.682953 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 17:04:42.682953 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 17:04:42.682953 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 17:04:42.682953 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 17:04:42.682953 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Jul 14 17:04:42.683873 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8466f0-019e-480f-b376-9d53ae58f592 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:42.683955 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 240/495] 10.222.0.136 () {56 vars in 1107 bytes} [Thu Jul 14 17:04:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:04:42.683955 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2f4efc-90b5-457f-8464-af28afa7ec12 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:42.707237 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:42.782224 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2f4efc-90b5-457f-8464-af28afa7ec12 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:42.783740 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8466f0-019e-480f-b376-9d53ae58f592 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:42.815031 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e523f83-b708-45f7-91f3-b8220f869777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:42.815694 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e523f83-b708-45f7-91f3-b8220f869777 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:42.815982 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e523f83-b708-45f7-91f3-b8220f869777 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:42.816260 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e523f83-b708-45f7-91f3-b8220f869777 None admin] PATH_INFO: `/v3/users` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:42.817399 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830e3d01-36f4-4820-bfc3-5490f648be8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:42.817656 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e523f83-b708-45f7-91f3-b8220f869777 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:04:42.818023 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e523f83-b708-45f7-91f3-b8220f869777 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:42.818124 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830e3d01-36f4-4820-bfc3-5490f648be8a None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:42.818359 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830e3d01-36f4-4820-bfc3-5490f648be8a None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:42.818636 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830e3d01-36f4-4820-bfc3-5490f648be8a None admin] PATH_INFO: `/v3/domains` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:42.819354 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830e3d01-36f4-4820-bfc3-5490f648be8a None admin] RBAC: Adding query filter params (name=Default) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:04:42.819444 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e523f83-b708-45f7-91f3-b8220f869777 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:42.819665 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830e3d01-36f4-4820-bfc3-5490f648be8a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:42.821004 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830e3d01-36f4-4820-bfc3-5490f648be8a None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:42.833142 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 256/496] 10.222.0.136 () {56 vars in 1114 bytes} [Thu Jul 14 17:04:42 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:04:42.833898 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830e3d01-36f4-4820-bfc3-5490f648be8a None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:42.857097 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 241/497] 10.222.0.136 () {56 vars in 1138 bytes} [Thu Jul 14 17:04:42 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:04:42.857965 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e523f83-b708-45f7-91f3-b8220f869777 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:42.909700 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:42.919956 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:42.940563 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830e3d01-36f4-4820-bfc3-5490f648be8a None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:42.969491 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e523f83-b708-45f7-91f3-b8220f869777 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:42.982946 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4487b9-1996-42a8-af14-307095860858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:42.983612 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4487b9-1996-42a8-af14-307095860858 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:42.983902 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4487b9-1996-42a8-af14-307095860858 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:42.984184 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4487b9-1996-42a8-af14-307095860858 None admin] PATH_INFO: `/v3/domains` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:42.984912 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4487b9-1996-42a8-af14-307095860858 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:04:42.985230 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4487b9-1996-42a8-af14-307095860858 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:42.986648 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4487b9-1996-42a8-af14-307095860858 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:42.999533 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 257/498] 10.222.0.136 () {56 vars in 1114 bytes} [Thu Jul 14 17:04:42 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:04:43.000174 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4487b9-1996-42a8-af14-307095860858 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:43.016957 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2042cac9-de3b-4bc7-951f-e28ddcdb0e1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:43.017667 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2042cac9-de3b-4bc7-951f-e28ddcdb0e1c None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:43.017954 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2042cac9-de3b-4bc7-951f-e28ddcdb0e1c None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:43.018231 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2042cac9-de3b-4bc7-951f-e28ddcdb0e1c None admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:43.018979 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2042cac9-de3b-4bc7-951f-e28ddcdb0e1c None admin] RBAC: Adding query filter params (name=service) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:04:43.019285 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2042cac9-de3b-4bc7-951f-e28ddcdb0e1c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:43.020664 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2042cac9-de3b-4bc7-951f-e28ddcdb0e1c None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:43.028672 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 242/499] 10.222.0.136 () {56 vars in 1108 bytes} [Thu Jul 14 17:04:42 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:04:43.029449 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2042cac9-de3b-4bc7-951f-e28ddcdb0e1c None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:43.107775 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4487b9-1996-42a8-af14-307095860858 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:43.130354 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2042cac9-de3b-4bc7-951f-e28ddcdb0e1c None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:43.142455 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7ebc85-7323-44c4-a85f-c3993c48d864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:43.143035 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:43.143239 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7ebc85-7323-44c4-a85f-c3993c48d864 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:43.143524 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7ebc85-7323-44c4-a85f-c3993c48d864 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:43.143800 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7ebc85-7323-44c4-a85f-c3993c48d864 None admin] PATH_INFO: `/v3/users/glance` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:43.151949 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7ebc85-7323-44c4-a85f-c3993c48d864 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:43.153427 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7ebc85-7323-44c4-a85f-c3993c48d864 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:43.164720 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ccba74-d549-40c1-b18c-c1fdc3703990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:43.165378 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ccba74-d549-40c1-b18c-c1fdc3703990 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:43.165704 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ccba74-d549-40c1-b18c-c1fdc3703990 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:43.165991 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ccba74-d549-40c1-b18c-c1fdc3703990 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:43.168941 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-bb7ebc85-7323-44c4-a85f-c3993c48d864 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 14 17:04:43.168941 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:04:43.168941 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:04:43.168941 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:04:43.168941 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:04:43.168941 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:04:43.168941 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:04:43.168941 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:04:43.168941 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:04:43.168941 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:04:43.168941 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:04:43.168941 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:04:43.168941 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 17:04:43.168941 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 17:04:43.168941 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 17:04:43.168941 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 17:04:43.169992 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:04:43.169992 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:04:43.169992 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 17:04:43.169992 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 17:04:43.169992 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 17:04:43.169992 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 17:04:43.169992 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:04:43.169992 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:04:43.169992 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:04:43.169992 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:04:43.169992 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:04:43.169992 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Jul 14 17:04:43.169992 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:04:43.169992 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:04:43.169992 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:04:43.169992 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:04:43.169992 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:04:43.169992 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:04:43.171098 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:04:43.171098 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:04:43.171098 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 17:04:43.171098 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 17:04:43.171098 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 17:04:43.171098 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 17:04:43.171098 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 17:04:43.171098 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 17:04:43.171098 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 14 17:04:43.171098 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Jul 14 17:04:43.171098 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 258/500] 10.222.0.136 () {56 vars in 1104 bytes} [Thu Jul 14 17:04:42 2022] GET /identity/v3/users/glance => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:04:43.171098 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7ebc85-7323-44c4-a85f-c3993c48d864 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:43.174359 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:43.241024 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ccba74-d549-40c1-b18c-c1fdc3703990 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:43.242533 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ccba74-d549-40c1-b18c-c1fdc3703990 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:43.276066 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7ebc85-7323-44c4-a85f-c3993c48d864 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:43.313211 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e780f8-9265-4a92-a06c-012048e11b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:43.314117 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e780f8-9265-4a92-a06c-012048e11b04 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:43.314403 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e780f8-9265-4a92-a06c-012048e11b04 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:43.314685 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e780f8-9265-4a92-a06c-012048e11b04 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:43.322936 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e780f8-9265-4a92-a06c-012048e11b04 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:43.324378 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e780f8-9265-4a92-a06c-012048e11b04 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:43.339131 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-65e780f8-9265-4a92-a06c-012048e11b04 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 14 17:04:43.339131 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:04:43.339131 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:04:43.339131 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:04:43.339131 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:04:43.339131 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:04:43.339131 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:04:43.339131 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:04:43.339131 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:04:43.339131 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:04:43.339131 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:04:43.339131 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:04:43.339131 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 17:04:43.339131 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 17:04:43.339131 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 17:04:43.339131 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 17:04:43.340059 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:04:43.340059 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:04:43.340059 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 17:04:43.340059 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 17:04:43.340059 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 17:04:43.340059 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 17:04:43.340059 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:04:43.340059 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:04:43.340059 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:04:43.340059 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:04:43.340059 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:04:43.340059 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Jul 14 17:04:43.340059 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:04:43.340059 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:04:43.340059 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:04:43.340059 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:04:43.340059 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:04:43.340059 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:04:43.340965 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:04:43.340965 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:04:43.340965 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 17:04:43.340965 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 17:04:43.340965 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 17:04:43.340965 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 17:04:43.340965 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 17:04:43.340965 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 17:04:43.340965 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 14 17:04:43.340965 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Jul 14 17:04:43.340965 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 259/501] 10.222.0.136 () {56 vars in 1104 bytes} [Thu Jul 14 17:04:43 2022] GET /identity/v3/users/cinder => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:04:43.341571 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e780f8-9265-4a92-a06c-012048e11b04 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:43.354005 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 243/502] 10.222.0.136 () {58 vars in 1287 bytes} [Thu Jul 14 17:04:43 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 17:04:43.354849 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ccba74-d549-40c1-b18c-c1fdc3703990 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:43.370165 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:43.402850 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:43.442270 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e780f8-9265-4a92-a06c-012048e11b04 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:43.458458 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ccba74-d549-40c1-b18c-c1fdc3703990 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:43.476003 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeae91e9-c339-4f13-a822-8d4050767b6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:43.476799 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeae91e9-c339-4f13-a822-8d4050767b6c None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:43.477087 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeae91e9-c339-4f13-a822-8d4050767b6c None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:43.477368 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeae91e9-c339-4f13-a822-8d4050767b6c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:43.488340 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeae91e9-c339-4f13-a822-8d4050767b6c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:43.489917 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeae91e9-c339-4f13-a822-8d4050767b6c None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:43.491857 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5213d2-3f0a-48e7-9a1c-47629918a3e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:43.492525 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5213d2-3f0a-48e7-9a1c-47629918a3e6 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:43.492809 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5213d2-3f0a-48e7-9a1c-47629918a3e6 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:43.493085 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5213d2-3f0a-48e7-9a1c-47629918a3e6 None admin] PATH_INFO: `/v3/users` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:43.493976 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5213d2-3f0a-48e7-9a1c-47629918a3e6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:04:43.494274 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5213d2-3f0a-48e7-9a1c-47629918a3e6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:43.495691 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5213d2-3f0a-48e7-9a1c-47629918a3e6 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:43.507572 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-eeae91e9-c339-4f13-a822-8d4050767b6c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:04:43.507572 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:04:43.507572 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:04:43.507572 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:04:43.507572 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:04:43.507572 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:04:43.507572 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:04:43.507572 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:04:43.507572 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:04:43.507572 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:04:43.507572 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:04:43.507572 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:04:43.507572 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 17:04:43.507572 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 17:04:43.507572 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 17:04:43.508454 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 17:04:43.508454 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:04:43.508454 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:04:43.508454 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:04:43.508454 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:04:43.508454 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:04:43.508454 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:04:43.508454 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:04:43.508454 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Jul 14 17:04:43.508454 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:04:43.508454 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:04:43.508454 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:04:43.508454 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:04:43.508454 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:04:43.508454 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:04:43.508454 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:04:43.508454 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:04:43.509608 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 17:04:43.509608 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 17:04:43.509608 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:04:43.509608 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Jul 14 17:04:43.509608 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 260/503] 10.222.0.136 () {56 vars in 1113 bytes} [Thu Jul 14 17:04:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:04:43.510068 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeae91e9-c339-4f13-a822-8d4050767b6c None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:43.513924 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 244/504] 10.222.0.136 () {56 vars in 1142 bytes} [Thu Jul 14 17:04:43 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 374 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:04:43.514635 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5213d2-3f0a-48e7-9a1c-47629918a3e6 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:43.585687 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:43.617026 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5213d2-3f0a-48e7-9a1c-47629918a3e6 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:43.622097 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeae91e9-c339-4f13-a822-8d4050767b6c None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:43.636061 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:43.651762 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6febaf8-7548-4e5f-ad7b-ac4198fb8e1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:43.652551 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6febaf8-7548-4e5f-ad7b-ac4198fb8e1d None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:43.652838 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6febaf8-7548-4e5f-ad7b-ac4198fb8e1d None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:43.653118 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6febaf8-7548-4e5f-ad7b-ac4198fb8e1d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:43.657128 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21513955-0859-414f-b862-be3210b7ec9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:43.657824 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21513955-0859-414f-b862-be3210b7ec9e None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:43.658110 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21513955-0859-414f-b862-be3210b7ec9e None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:43.658446 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21513955-0859-414f-b862-be3210b7ec9e None admin] PATH_INFO: `/v3/users` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:43.659290 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21513955-0859-414f-b862-be3210b7ec9e None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:04:43.659607 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21513955-0859-414f-b862-be3210b7ec9e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:43.661101 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21513955-0859-414f-b862-be3210b7ec9e None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:43.663271 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6febaf8-7548-4e5f-ad7b-ac4198fb8e1d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:43.664711 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6febaf8-7548-4e5f-ad7b-ac4198fb8e1d None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:43.682719 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-d6febaf8-7548-4e5f-ad7b-ac4198fb8e1d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:04:43.682719 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:04:43.682719 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:04:43.682719 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:04:43.682719 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:04:43.682719 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:04:43.682719 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:04:43.682719 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:04:43.682719 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:04:43.682719 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:04:43.682719 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:04:43.682719 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:04:43.682719 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 17:04:43.682719 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 17:04:43.682719 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 17:04:43.683622 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 17:04:43.683622 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:04:43.683622 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:04:43.683622 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:04:43.683622 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:04:43.683622 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:04:43.683622 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:04:43.683622 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:04:43.683622 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Jul 14 17:04:43.683622 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:04:43.683622 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:04:43.683622 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:04:43.683622 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:04:43.683622 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:04:43.683622 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:04:43.683622 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:04:43.683622 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:04:43.684478 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 17:04:43.684478 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 17:04:43.684478 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:04:43.684478 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Jul 14 17:04:43.684478 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 245/505] 10.222.0.136 () {56 vars in 1113 bytes} [Thu Jul 14 17:04:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:04:43.684760 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6febaf8-7548-4e5f-ad7b-ac4198fb8e1d None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:43.701432 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 261/506] 10.222.0.136 () {56 vars in 1142 bytes} [Thu Jul 14 17:04:43 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 374 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:04:43.702313 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21513955-0859-414f-b862-be3210b7ec9e None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:43.787251 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6febaf8-7548-4e5f-ad7b-ac4198fb8e1d None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:43.805296 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21513955-0859-414f-b862-be3210b7ec9e None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:43.810759 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:43.823897 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b69c2d-76d4-41bc-8242-e89db57ea8af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:43.824663 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b69c2d-76d4-41bc-8242-e89db57ea8af None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:43.824957 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b69c2d-76d4-41bc-8242-e89db57ea8af None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:43.825243 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b69c2d-76d4-41bc-8242-e89db57ea8af None admin] PATH_INFO: `/v3/domains` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:43.825998 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b69c2d-76d4-41bc-8242-e89db57ea8af None admin] RBAC: Adding query filter params (name=Default) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:04:43.826313 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b69c2d-76d4-41bc-8242-e89db57ea8af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:43.827699 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b69c2d-76d4-41bc-8242-e89db57ea8af None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:43.840688 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de02cbc6-f138-41e7-bdaa-855efcc01217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:43.840842 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 246/507] 10.222.0.136 () {56 vars in 1114 bytes} [Thu Jul 14 17:04:43 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:04:43.841184 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de02cbc6-f138-41e7-bdaa-855efcc01217 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:43.841314 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b69c2d-76d4-41bc-8242-e89db57ea8af None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:43.841479 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de02cbc6-f138-41e7-bdaa-855efcc01217 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:43.841834 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de02cbc6-f138-41e7-bdaa-855efcc01217 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:43.885365 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:43.913400 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de02cbc6-f138-41e7-bdaa-855efcc01217 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:43.915008 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de02cbc6-f138-41e7-bdaa-855efcc01217 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:43.945255 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b69c2d-76d4-41bc-8242-e89db57ea8af None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:43.979671 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637b5179-1425-4367-b2a0-e532656c8560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:43.980344 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637b5179-1425-4367-b2a0-e532656c8560 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:43.980897 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637b5179-1425-4367-b2a0-e532656c8560 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:43.981183 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637b5179-1425-4367-b2a0-e532656c8560 None admin] PATH_INFO: `/v3/domains` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:43.981936 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637b5179-1425-4367-b2a0-e532656c8560 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:04:43.982250 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637b5179-1425-4367-b2a0-e532656c8560 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:43.983668 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637b5179-1425-4367-b2a0-e532656c8560 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:43.995566 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 247/508] 10.222.0.136 () {56 vars in 1114 bytes} [Thu Jul 14 17:04:43 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:04:43.996377 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637b5179-1425-4367-b2a0-e532656c8560 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:44.021306 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 262/509] 10.222.0.136 () {58 vars in 1287 bytes} [Thu Jul 14 17:04:43 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 17:04:44.022270 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de02cbc6-f138-41e7-bdaa-855efcc01217 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:44.042675 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:44.092871 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:44.102145 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637b5179-1425-4367-b2a0-e532656c8560 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:44.124945 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de02cbc6-f138-41e7-bdaa-855efcc01217 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:44.136222 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56c52f7-d0c4-4f12-9cda-76260eb9a982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:44.136812 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56c52f7-d0c4-4f12-9cda-76260eb9a982 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:44.137097 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56c52f7-d0c4-4f12-9cda-76260eb9a982 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:44.137377 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56c52f7-d0c4-4f12-9cda-76260eb9a982 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:44.161467 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c8fcd0-89f7-4487-8f7b-9540ac14a95c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:44.162292 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c8fcd0-89f7-4487-8f7b-9540ac14a95c None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:44.162572 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c8fcd0-89f7-4487-8f7b-9540ac14a95c None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:44.162845 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c8fcd0-89f7-4487-8f7b-9540ac14a95c None admin] PATH_INFO: `/v3/users/neutron` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:44.169884 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c8fcd0-89f7-4487-8f7b-9540ac14a95c None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:44.171326 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c8fcd0-89f7-4487-8f7b-9540ac14a95c None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:44.185724 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-62c8fcd0-89f7-4487-8f7b-9540ac14a95c None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 14 17:04:44.185724 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:04:44.185724 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:04:44.185724 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:04:44.185724 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:04:44.185724 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:04:44.185724 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:04:44.185724 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:04:44.185724 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:04:44.185724 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:04:44.185724 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:04:44.185724 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:04:44.185724 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 17:04:44.185724 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 17:04:44.185724 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 17:04:44.185724 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 17:04:44.186793 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:04:44.186793 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:04:44.186793 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 17:04:44.186793 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 17:04:44.186793 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 17:04:44.186793 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 17:04:44.186793 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:04:44.186793 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:04:44.186793 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:04:44.186793 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:04:44.186793 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:04:44.186793 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Jul 14 17:04:44.186793 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:04:44.186793 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:04:44.186793 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:04:44.186793 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:04:44.186793 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:04:44.186793 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:04:44.187701 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:04:44.187701 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:04:44.187701 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 17:04:44.187701 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 17:04:44.187701 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 17:04:44.187701 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 17:04:44.187701 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 17:04:44.187701 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 17:04:44.187701 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 14 17:04:44.187701 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Jul 14 17:04:44.187701 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 263/510] 10.222.0.136 () {56 vars in 1107 bytes} [Thu Jul 14 17:04:44 2022] GET /identity/v3/users/neutron => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:04:44.187701 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c8fcd0-89f7-4487-8f7b-9540ac14a95c None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:44.208487 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56c52f7-d0c4-4f12-9cda-76260eb9a982 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:44.210007 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56c52f7-d0c4-4f12-9cda-76260eb9a982 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:44.251361 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:44.296985 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c8fcd0-89f7-4487-8f7b-9540ac14a95c None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:44.311730 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 248/511] 10.222.0.136 () {58 vars in 1287 bytes} [Thu Jul 14 17:04:43 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 17:04:44.312566 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56c52f7-d0c4-4f12-9cda-76260eb9a982 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:44.326966 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:44.332867 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866ba9c2-d05b-4feb-9964-1916d4c6d736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:44.333973 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866ba9c2-d05b-4feb-9964-1916d4c6d736 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:44.334266 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866ba9c2-d05b-4feb-9964-1916d4c6d736 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:44.334545 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866ba9c2-d05b-4feb-9964-1916d4c6d736 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:44.341335 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866ba9c2-d05b-4feb-9964-1916d4c6d736 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:44.342828 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866ba9c2-d05b-4feb-9964-1916d4c6d736 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:44.358168 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-866ba9c2-d05b-4feb-9964-1916d4c6d736 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 17:04:44.358168 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:04:44.358168 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:04:44.358168 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:04:44.358168 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:04:44.358168 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:04:44.358168 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:04:44.358168 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:04:44.358168 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:04:44.358168 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:04:44.358168 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:04:44.358168 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:04:44.358168 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 17:04:44.358168 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 17:04:44.358168 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 17:04:44.359061 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 17:04:44.359061 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:04:44.359061 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:04:44.359061 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:04:44.359061 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:04:44.359061 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:04:44.359061 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:04:44.359061 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:04:44.359061 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Jul 14 17:04:44.359061 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:04:44.359061 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:04:44.359061 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:04:44.359061 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:04:44.359061 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:04:44.359061 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:04:44.359061 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:04:44.359061 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:04:44.359921 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 17:04:44.359921 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 17:04:44.359921 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 17:04:44.359921 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 17:04:44.359921 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 17:04:44.359921 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 17:04:44.359921 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 17:04:44.359921 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Jul 14 17:04:44.359921 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 264/512] 10.222.0.136 () {56 vars in 1116 bytes} [Thu Jul 14 17:04:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:04:44.360381 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866ba9c2-d05b-4feb-9964-1916d4c6d736 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:44.415906 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56c52f7-d0c4-4f12-9cda-76260eb9a982 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:44.450406 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0870e451-05f1-4fd7-b3c9-a0bf328cde11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:44.451197 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0870e451-05f1-4fd7-b3c9-a0bf328cde11 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:44.451492 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0870e451-05f1-4fd7-b3c9-a0bf328cde11 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:44.451771 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0870e451-05f1-4fd7-b3c9-a0bf328cde11 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:44.460316 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866ba9c2-d05b-4feb-9964-1916d4c6d736 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:44.461801 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0870e451-05f1-4fd7-b3c9-a0bf328cde11 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:44.463254 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0870e451-05f1-4fd7-b3c9-a0bf328cde11 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:44.464943 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:44.481256 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-0870e451-05f1-4fd7-b3c9-a0bf328cde11 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:04:44.481256 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:04:44.481256 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:04:44.481256 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:04:44.481256 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:04:44.481256 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:04:44.481256 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:04:44.481256 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:04:44.481256 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:04:44.481256 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:04:44.481256 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:04:44.481256 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:04:44.481256 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 17:04:44.481256 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 17:04:44.481256 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 17:04:44.482176 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 17:04:44.482176 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:04:44.482176 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:04:44.482176 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:04:44.482176 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:04:44.482176 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:04:44.482176 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:04:44.482176 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:04:44.482176 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Jul 14 17:04:44.482176 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:04:44.482176 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:04:44.482176 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:04:44.482176 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:04:44.482176 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:04:44.482176 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:04:44.482176 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:04:44.482176 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:04:44.483057 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 17:04:44.483057 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 17:04:44.483057 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:04:44.483057 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Jul 14 17:04:44.483057 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 249/513] 10.222.0.136 () {56 vars in 1113 bytes} [Thu Jul 14 17:04:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:04:44.483350 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0870e451-05f1-4fd7-b3c9-a0bf328cde11 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:44.499413 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edea929-6285-4a32-b13e-01f030123051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:44.500080 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edea929-6285-4a32-b13e-01f030123051 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:44.500370 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edea929-6285-4a32-b13e-01f030123051 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:44.500652 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edea929-6285-4a32-b13e-01f030123051 None admin] PATH_INFO: `/v3/users` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:44.501492 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edea929-6285-4a32-b13e-01f030123051 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:04:44.501905 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edea929-6285-4a32-b13e-01f030123051 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:44.503277 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edea929-6285-4a32-b13e-01f030123051 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:44.521355 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 265/514] 10.222.0.136 () {56 vars in 1144 bytes} [Thu Jul 14 17:04:44 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 376 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:04:44.522206 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edea929-6285-4a32-b13e-01f030123051 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:44.573087 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:44.586580 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0870e451-05f1-4fd7-b3c9-a0bf328cde11 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:44.624249 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edea929-6285-4a32-b13e-01f030123051 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:44.624810 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea93d866-11f5-4162-8059-e5f40e7c80ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:44.625700 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea93d866-11f5-4162-8059-e5f40e7c80ea None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:44.625931 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea93d866-11f5-4162-8059-e5f40e7c80ea None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:44.626216 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea93d866-11f5-4162-8059-e5f40e7c80ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:44.636802 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea93d866-11f5-4162-8059-e5f40e7c80ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:44.638310 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea93d866-11f5-4162-8059-e5f40e7c80ea None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:44.656183 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-ea93d866-11f5-4162-8059-e5f40e7c80ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:04:44.656183 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:04:44.656183 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:04:44.656183 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:04:44.656183 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:04:44.656183 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:04:44.656183 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:04:44.656183 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:04:44.656183 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:04:44.656183 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:04:44.656183 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:04:44.656183 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:04:44.656183 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 17:04:44.656183 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 17:04:44.656183 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 17:04:44.657047 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 17:04:44.657047 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:04:44.657047 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:04:44.657047 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:04:44.657047 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:04:44.657047 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:04:44.657047 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:04:44.657047 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:04:44.657047 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Jul 14 17:04:44.657047 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:04:44.657047 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:04:44.657047 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:04:44.657047 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:04:44.657047 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:04:44.657047 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:04:44.657047 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:04:44.657047 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:04:44.657936 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 17:04:44.657936 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 17:04:44.657936 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:04:44.657936 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Jul 14 17:04:44.657936 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 250/515] 10.222.0.136 () {56 vars in 1113 bytes} [Thu Jul 14 17:04:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:04:44.658389 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea93d866-11f5-4162-8059-e5f40e7c80ea None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:44.662168 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2c37d0-bfc1-4069-bc5d-6694ab1a4aba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:44.663693 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2c37d0-bfc1-4069-bc5d-6694ab1a4aba None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:44.663985 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2c37d0-bfc1-4069-bc5d-6694ab1a4aba None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:44.664270 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2c37d0-bfc1-4069-bc5d-6694ab1a4aba None admin] PATH_INFO: `/v3/projects` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:44.665075 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2c37d0-bfc1-4069-bc5d-6694ab1a4aba None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:04:44.665392 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2c37d0-bfc1-4069-bc5d-6694ab1a4aba None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:44.666918 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2c37d0-bfc1-4069-bc5d-6694ab1a4aba None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:44.685194 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 266/516] 10.222.0.136 () {56 vars in 1153 bytes} [Thu Jul 14 17:04:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:04:44.686033 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2c37d0-bfc1-4069-bc5d-6694ab1a4aba None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:44.710496 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:44.764134 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea93d866-11f5-4162-8059-e5f40e7c80ea None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:44.788599 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2c37d0-bfc1-4069-bc5d-6694ab1a4aba None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:44.798695 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989d3c4b-824f-4b79-8f9c-e59e511e5647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:44.799083 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:44.799365 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989d3c4b-824f-4b79-8f9c-e59e511e5647 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:44.799659 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989d3c4b-824f-4b79-8f9c-e59e511e5647 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:44.800152 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989d3c4b-824f-4b79-8f9c-e59e511e5647 None admin] PATH_INFO: `/v3/domains` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:44.800730 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989d3c4b-824f-4b79-8f9c-e59e511e5647 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:04:44.801146 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989d3c4b-824f-4b79-8f9c-e59e511e5647 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:44.803080 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989d3c4b-824f-4b79-8f9c-e59e511e5647 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:44.814186 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 251/517] 10.222.0.136 () {56 vars in 1114 bytes} [Thu Jul 14 17:04:44 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:04:44.814974 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989d3c4b-824f-4b79-8f9c-e59e511e5647 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:44.827879 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc10b8ae-2ac7-460c-89aa-1ebe9e4f717d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:44.828524 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc10b8ae-2ac7-460c-89aa-1ebe9e4f717d None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:44.828807 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc10b8ae-2ac7-460c-89aa-1ebe9e4f717d None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:44.829086 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc10b8ae-2ac7-460c-89aa-1ebe9e4f717d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:44.901864 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc10b8ae-2ac7-460c-89aa-1ebe9e4f717d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:44.903331 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc10b8ae-2ac7-460c-89aa-1ebe9e4f717d None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:44.916256 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989d3c4b-824f-4b79-8f9c-e59e511e5647 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:44.923326 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:44.954712 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5981cf53-4f94-4d91-9d41-f0ff0cd86bc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:44.955385 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5981cf53-4f94-4d91-9d41-f0ff0cd86bc4 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:44.955675 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5981cf53-4f94-4d91-9d41-f0ff0cd86bc4 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:44.955957 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5981cf53-4f94-4d91-9d41-f0ff0cd86bc4 None admin] PATH_INFO: `/v3/domains` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:44.956714 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5981cf53-4f94-4d91-9d41-f0ff0cd86bc4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:04:44.957021 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5981cf53-4f94-4d91-9d41-f0ff0cd86bc4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:44.959184 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5981cf53-4f94-4d91-9d41-f0ff0cd86bc4 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:44.970429 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 252/518] 10.222.0.136 () {56 vars in 1114 bytes} [Thu Jul 14 17:04:44 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:04:44.971299 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5981cf53-4f94-4d91-9d41-f0ff0cd86bc4 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:45.007836 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 267/519] 10.222.0.136 () {58 vars in 1287 bytes} [Thu Jul 14 17:04:44 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 17:04:45.008683 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc10b8ae-2ac7-460c-89aa-1ebe9e4f717d None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:45.022207 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:45.080293 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5981cf53-4f94-4d91-9d41-f0ff0cd86bc4 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:45.114244 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc10b8ae-2ac7-460c-89aa-1ebe9e4f717d None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:45.118339 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a14a33a-b571-4d7e-b6da-5c5c85bcda91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:45.119106 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a14a33a-b571-4d7e-b6da-5c5c85bcda91 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:45.119476 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a14a33a-b571-4d7e-b6da-5c5c85bcda91 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:45.119834 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a14a33a-b571-4d7e-b6da-5c5c85bcda91 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:45.120666 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a14a33a-b571-4d7e-b6da-5c5c85bcda91 None admin] RBAC: Adding query filter params (role.id=5e0ec7345cc84921907ca95b801a656b, scope.project.id=d57eaa6dbca24cbb99dce1fe3437ecae, user.id=bc2b7d015c2046ddacac6e682f22d0f5) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:04:45.120988 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a14a33a-b571-4d7e-b6da-5c5c85bcda91 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:45.122464 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a14a33a-b571-4d7e-b6da-5c5c85bcda91 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:45.127920 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 253/520] 10.222.0.136 () {56 vars in 1379 bytes} [Thu Jul 14 17:04:44 2022] GET /identity/v3/role_assignments?user.id=bc2b7d015c2046ddacac6e682f22d0f5&scope.project.id=d57eaa6dbca24cbb99dce1fe3437ecae&role.id=5e0ec7345cc84921907ca95b801a656b => generated 260 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:04:45.128699 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a14a33a-b571-4d7e-b6da-5c5c85bcda91 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:45.156894 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b350c642-9f96-4ac6-b472-64b2cb2450b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:45.157931 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b350c642-9f96-4ac6-b472-64b2cb2450b2 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:45.158223 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b350c642-9f96-4ac6-b472-64b2cb2450b2 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:45.158508 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b350c642-9f96-4ac6-b472-64b2cb2450b2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:45.167637 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b350c642-9f96-4ac6-b472-64b2cb2450b2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:45.169141 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b350c642-9f96-4ac6-b472-64b2cb2450b2 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:45.171137 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:45.188065 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-b350c642-9f96-4ac6-b472-64b2cb2450b2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 17:04:45.188065 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:04:45.188065 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:04:45.188065 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:04:45.188065 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:04:45.188065 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:04:45.188065 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:04:45.188065 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:04:45.188065 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:04:45.188065 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:04:45.188065 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:04:45.188065 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:04:45.188065 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 17:04:45.188065 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 17:04:45.188065 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 17:04:45.189144 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 17:04:45.189144 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:04:45.189144 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:04:45.189144 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:04:45.189144 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:04:45.189144 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:04:45.189144 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:04:45.189144 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:04:45.189144 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Jul 14 17:04:45.189144 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:04:45.189144 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:04:45.189144 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:04:45.189144 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:04:45.189144 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:04:45.189144 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:04:45.189144 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:04:45.189144 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:04:45.190271 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 17:04:45.190271 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 17:04:45.190271 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 17:04:45.190271 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 17:04:45.190271 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 17:04:45.190271 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 17:04:45.190271 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 17:04:45.190271 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Jul 14 17:04:45.191439 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 268/521] 10.222.0.136 () {56 vars in 1116 bytes} [Thu Jul 14 17:04:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:04:45.195588 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b350c642-9f96-4ac6-b472-64b2cb2450b2 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:45.262813 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a14a33a-b571-4d7e-b6da-5c5c85bcda91 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:45.283058 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:45.307934 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9388931-8fb0-4968-b206-ad620272dcfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:45.308154 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9388931-8fb0-4968-b206-ad620272dcfe None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:45.308510 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9388931-8fb0-4968-b206-ad620272dcfe None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:45.308797 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9388931-8fb0-4968-b206-ad620272dcfe None admin] PATH_INFO: `/v3/projects/service` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:45.318885 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9388931-8fb0-4968-b206-ad620272dcfe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:45.320375 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9388931-8fb0-4968-b206-ad620272dcfe None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:45.320591 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b350c642-9f96-4ac6-b472-64b2cb2450b2 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:45.340868 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-e9388931-8fb0-4968-b206-ad620272dcfe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 17:04:45.340868 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:04:45.340868 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:04:45.340868 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:04:45.340868 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:04:45.340868 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:04:45.340868 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:04:45.340868 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:04:45.340868 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:04:45.340868 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:04:45.340868 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:04:45.340868 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:04:45.340868 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 17:04:45.340868 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 17:04:45.340868 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 17:04:45.342024 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 17:04:45.342024 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:04:45.342024 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:04:45.342024 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:04:45.342024 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:04:45.342024 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:04:45.342024 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:04:45.342024 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:04:45.342024 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Jul 14 17:04:45.342024 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:04:45.342024 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:04:45.342024 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:04:45.342024 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:04:45.342024 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:04:45.342024 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:04:45.342024 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:04:45.342024 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:04:45.347838 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 17:04:45.347838 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 17:04:45.347838 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 17:04:45.347838 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 17:04:45.347838 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 17:04:45.347838 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 17:04:45.347838 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 17:04:45.347838 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Jul 14 17:04:45.347838 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 254/522] 10.222.0.136 () {56 vars in 1116 bytes} [Thu Jul 14 17:04:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:04:45.347838 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9388931-8fb0-4968-b206-ad620272dcfe None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:45.359493 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37857c7-fc2d-4d0e-a340-a6ff855d36d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:45.360351 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37857c7-fc2d-4d0e-a340-a6ff855d36d7 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:45.360642 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37857c7-fc2d-4d0e-a340-a6ff855d36d7 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:45.360923 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37857c7-fc2d-4d0e-a340-a6ff855d36d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:45.373912 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37857c7-fc2d-4d0e-a340-a6ff855d36d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:45.375396 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37857c7-fc2d-4d0e-a340-a6ff855d36d7 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:45.393490 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-b37857c7-fc2d-4d0e-a340-a6ff855d36d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:04:45.393490 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:04:45.393490 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:04:45.393490 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:04:45.393490 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:04:45.393490 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:04:45.393490 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:04:45.393490 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:04:45.393490 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:04:45.393490 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:04:45.393490 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:04:45.393490 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:04:45.393490 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 17:04:45.393490 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 17:04:45.393490 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 17:04:45.394451 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 17:04:45.394451 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:04:45.394451 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:04:45.394451 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:04:45.394451 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:04:45.394451 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:04:45.394451 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:04:45.394451 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:04:45.394451 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Jul 14 17:04:45.394451 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:04:45.394451 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:04:45.394451 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:04:45.394451 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:04:45.394451 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:04:45.394451 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:04:45.394451 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:04:45.394451 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:04:45.396502 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 17:04:45.396502 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 17:04:45.396502 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:04:45.396502 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Jul 14 17:04:45.396502 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 269/523] 10.222.0.136 () {56 vars in 1113 bytes} [Thu Jul 14 17:04:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:04:45.397231 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37857c7-fc2d-4d0e-a340-a6ff855d36d7 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:45.455927 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:45.467001 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9388931-8fb0-4968-b206-ad620272dcfe None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:45.502102 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255ddb41-2128-469a-b327-6c771a2ac901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:45.502773 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255ddb41-2128-469a-b327-6c771a2ac901 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:45.503063 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255ddb41-2128-469a-b327-6c771a2ac901 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:45.503344 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255ddb41-2128-469a-b327-6c771a2ac901 None admin] PATH_INFO: `/v3/projects` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:45.504161 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255ddb41-2128-469a-b327-6c771a2ac901 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:04:45.505010 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255ddb41-2128-469a-b327-6c771a2ac901 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:45.506506 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255ddb41-2128-469a-b327-6c771a2ac901 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:45.514104 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37857c7-fc2d-4d0e-a340-a6ff855d36d7 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:45.524610 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 255/524] 10.222.0.136 () {56 vars in 1153 bytes} [Thu Jul 14 17:04:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:04:45.525436 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255ddb41-2128-469a-b327-6c771a2ac901 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:45.544689 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:45.558782 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a95df27-9011-4bc4-bd2d-e9a9398a7d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:45.559448 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a95df27-9011-4bc4-bd2d-e9a9398a7d3d None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:45.559739 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a95df27-9011-4bc4-bd2d-e9a9398a7d3d None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:45.560020 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a95df27-9011-4bc4-bd2d-e9a9398a7d3d None admin] PATH_INFO: `/v3/projects` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:45.560813 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a95df27-9011-4bc4-bd2d-e9a9398a7d3d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:04:45.561130 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a95df27-9011-4bc4-bd2d-e9a9398a7d3d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:45.562850 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a95df27-9011-4bc4-bd2d-e9a9398a7d3d None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:45.581234 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 270/525] 10.222.0.136 () {56 vars in 1153 bytes} [Thu Jul 14 17:04:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:04:45.581234 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a95df27-9011-4bc4-bd2d-e9a9398a7d3d None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:45.641967 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255ddb41-2128-469a-b327-6c771a2ac901 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:45.680729 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f6f840-d827-4783-82d8-81ff6e91f3fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:45.681431 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f6f840-d827-4783-82d8-81ff6e91f3fb None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:45.681788 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f6f840-d827-4783-82d8-81ff6e91f3fb None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:45.682105 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f6f840-d827-4783-82d8-81ff6e91f3fb None admin] PATH_INFO: `/v3/domains` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:45.682868 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f6f840-d827-4783-82d8-81ff6e91f3fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:04:45.683205 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f6f840-d827-4783-82d8-81ff6e91f3fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:45.684604 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f6f840-d827-4783-82d8-81ff6e91f3fb None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:45.702656 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 256/526] 10.222.0.136 () {56 vars in 1114 bytes} [Thu Jul 14 17:04:45 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:04:45.702858 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a95df27-9011-4bc4-bd2d-e9a9398a7d3d None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:45.702955 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f6f840-d827-4783-82d8-81ff6e91f3fb None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:45.718306 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:45.739843 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f1f49a-d359-4e1a-843f-54a98cb95cf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:45.740626 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f1f49a-d359-4e1a-843f-54a98cb95cf5 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:45.740968 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f1f49a-d359-4e1a-843f-54a98cb95cf5 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:45.741322 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f1f49a-d359-4e1a-843f-54a98cb95cf5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:45.742241 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f1f49a-d359-4e1a-843f-54a98cb95cf5 None admin] RBAC: Adding query filter params (role.id=5e0ec7345cc84921907ca95b801a656b, scope.project.id=d57eaa6dbca24cbb99dce1fe3437ecae, user.id=c2c3d46d376c460a99426a5dc7c66115) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:04:45.742558 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f1f49a-d359-4e1a-843f-54a98cb95cf5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:45.744085 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f1f49a-d359-4e1a-843f-54a98cb95cf5 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:45.757579 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 271/527] 10.222.0.136 () {56 vars in 1379 bytes} [Thu Jul 14 17:04:45 2022] GET /identity/v3/role_assignments?user.id=c2c3d46d376c460a99426a5dc7c66115&scope.project.id=d57eaa6dbca24cbb99dce1fe3437ecae&role.id=5e0ec7345cc84921907ca95b801a656b => generated 260 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:04:45.757579 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f1f49a-d359-4e1a-843f-54a98cb95cf5 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:45.810348 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:45.854292 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f6f840-d827-4783-82d8-81ff6e91f3fb None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:45.889935 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f1f49a-d359-4e1a-843f-54a98cb95cf5 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:45.907299 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b6b632-87a7-4f6e-a670-cd3733e044f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:45.908127 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b6b632-87a7-4f6e-a670-cd3733e044f0 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:45.908426 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b6b632-87a7-4f6e-a670-cd3733e044f0 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:45.908714 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b6b632-87a7-4f6e-a670-cd3733e044f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:45.909573 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b6b632-87a7-4f6e-a670-cd3733e044f0 None admin] RBAC: Adding query filter params (role.id=5e0ec7345cc84921907ca95b801a656b, scope.project.id=d57eaa6dbca24cbb99dce1fe3437ecae, user.id=5fc301707c5d4f759b61266af952e625) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:04:45.909935 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b6b632-87a7-4f6e-a670-cd3733e044f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:45.911917 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b6b632-87a7-4f6e-a670-cd3733e044f0 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:45.921129 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 257/528] 10.222.0.136 () {56 vars in 1379 bytes} [Thu Jul 14 17:04:45 2022] GET /identity/v3/role_assignments?user.id=5fc301707c5d4f759b61266af952e625&scope.project.id=d57eaa6dbca24cbb99dce1fe3437ecae&role.id=5e0ec7345cc84921907ca95b801a656b => generated 260 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:04:45.950148 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2fab22-e285-4d9f-bc34-3129950859f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:45.951076 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2fab22-e285-4d9f-bc34-3129950859f5 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:45.951365 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2fab22-e285-4d9f-bc34-3129950859f5 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:45.951644 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2fab22-e285-4d9f-bc34-3129950859f5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:45.961579 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2fab22-e285-4d9f-bc34-3129950859f5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:45.963085 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2fab22-e285-4d9f-bc34-3129950859f5 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:45.980127 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-9e2fab22-e285-4d9f-bc34-3129950859f5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 17:04:45.980127 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:04:45.980127 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:04:45.980127 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:04:45.980127 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:04:45.980127 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:04:45.980127 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:04:45.980127 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:04:45.980127 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:04:45.980127 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:04:45.980127 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:04:45.980127 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:04:45.980127 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 17:04:45.980127 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 17:04:45.980127 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 17:04:45.981287 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 17:04:45.981287 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:04:45.981287 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:04:45.981287 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:04:45.981287 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:04:45.981287 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:04:45.981287 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:04:45.981287 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:04:45.981287 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Jul 14 17:04:45.981287 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:04:45.981287 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:04:45.981287 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:04:45.981287 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:04:45.981287 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:04:45.981287 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:04:45.981287 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:04:45.981287 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:04:45.982445 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 17:04:45.982445 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 17:04:45.982445 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 17:04:45.982445 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 17:04:45.982445 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 17:04:45.982445 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 17:04:45.982445 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 17:04:45.982445 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Jul 14 17:04:45.982445 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 272/529] 10.222.0.136 () {56 vars in 1116 bytes} [Thu Jul 14 17:04:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:04:45.987317 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b6b632-87a7-4f6e-a670-cd3733e044f0 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:46.075591 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:46.107080 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b6b632-87a7-4f6e-a670-cd3733e044f0 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:46.145250 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c3b1ae-eb75-4746-abe8-084bf1185d7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:46.146148 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c3b1ae-eb75-4746-abe8-084bf1185d7e None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:46.146468 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c3b1ae-eb75-4746-abe8-084bf1185d7e None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:46.146780 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c3b1ae-eb75-4746-abe8-084bf1185d7e None admin] PATH_INFO: `/v3/projects` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:46.147575 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c3b1ae-eb75-4746-abe8-084bf1185d7e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:04:46.147898 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c3b1ae-eb75-4746-abe8-084bf1185d7e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:46.149355 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c3b1ae-eb75-4746-abe8-084bf1185d7e None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:46.162935 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 258/530] 10.222.0.136 () {56 vars in 1153 bytes} [Thu Jul 14 17:04:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 17:04:46.168638 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2fab22-e285-4d9f-bc34-3129950859f5 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:46.287190 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2fab22-e285-4d9f-bc34-3129950859f5 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:46.295527 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:46.326342 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5976f5e4-c082-4f79-9523-6dbfdb382136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:46.326990 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5976f5e4-c082-4f79-9523-6dbfdb382136 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:46.327325 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5976f5e4-c082-4f79-9523-6dbfdb382136 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:46.327612 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5976f5e4-c082-4f79-9523-6dbfdb382136 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:46.328451 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5976f5e4-c082-4f79-9523-6dbfdb382136 None admin] RBAC: Adding query filter params (role.id=5e0ec7345cc84921907ca95b801a656b, scope.project.id=d57eaa6dbca24cbb99dce1fe3437ecae, user.id=a8c6871e11f047e284afdb16bcb1d3a4) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:04:46.328767 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5976f5e4-c082-4f79-9523-6dbfdb382136 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:46.330234 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5976f5e4-c082-4f79-9523-6dbfdb382136 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:46.336992 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 273/531] 10.222.0.136 () {56 vars in 1379 bytes} [Thu Jul 14 17:04:46 2022] GET /identity/v3/role_assignments?user.id=a8c6871e11f047e284afdb16bcb1d3a4&scope.project.id=d57eaa6dbca24cbb99dce1fe3437ecae&role.id=5e0ec7345cc84921907ca95b801a656b => generated 260 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:04:47.442684 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc77bb47-d0b4-44d3-acb3-e6ed77008fea None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:47.443218 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc77bb47-d0b4-44d3-acb3-e6ed77008fea None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:47.443497 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc77bb47-d0b4-44d3-acb3-e6ed77008fea None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:47.444950 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 259/532] 10.222.0.136 () {54 vars in 931 bytes} [Thu Jul 14 17:04:47 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:04:47.450485 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6ae042-5d99-434b-8d25-9d8d1d0d13a4 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:47.450896 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6ae042-5d99-434b-8d25-9d8d1d0d13a4 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:47.451081 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6ae042-5d99-434b-8d25-9d8d1d0d13a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:47.468482 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-8d6ae042-5d99-434b-8d25-9d8d1d0d13a4 None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:04:47.469638 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-8d6ae042-5d99-434b-8d25-9d8d1d0d13a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:04:47.542642 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 274/533] 10.222.0.136 () {58 vars in 1028 bytes} [Thu Jul 14 17:04:47 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 17:04:47.566927 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc77bb47-d0b4-44d3-acb3-e6ed77008fea None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:47.674492 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc77bb47-d0b4-44d3-acb3-e6ed77008fea None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:47.716540 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7f85f1-d2b0-426c-8012-05e62acb8bd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:47.717654 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7f85f1-d2b0-426c-8012-05e62acb8bd2 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:47.718099 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7f85f1-d2b0-426c-8012-05e62acb8bd2 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:47.718572 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7f85f1-d2b0-426c-8012-05e62acb8bd2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:47.720592 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:47.730101 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7f85f1-d2b0-426c-8012-05e62acb8bd2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 17:04:47.739390 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-8e7f85f1-d2b0-426c-8012-05e62acb8bd2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 17:04:47.739390 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:04:47.739390 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:04:47.739390 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:04:47.739390 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:04:47.739390 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:04:47.739390 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:04:47.739390 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:04:47.739390 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:04:47.739390 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:04:47.739390 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:04:47.739390 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:04:47.739390 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 17:04:47.739390 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 17:04:47.739390 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 17:04:47.739390 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 17:04:47.740654 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 17:04:47.740654 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 17:04:47.740654 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 17:04:47.740654 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 17:04:47.740654 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:04:47.740654 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:04:47.740654 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:04:47.740654 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:04:47.740654 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:04:47.740654 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:04:47.740654 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:04:47.740654 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Jul 14 17:04:47.740654 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:04:47.740654 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:04:47.740654 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:04:47.740654 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:04:47.741729 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:04:47.741729 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:04:47.741729 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:04:47.741729 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:04:47.741729 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 17:04:47.741729 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 17:04:47.741729 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 17:04:47.741729 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 17:04:47.741729 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 17:04:47.741729 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 17:04:47.741729 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 17:04:47.741729 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Jul 14 17:04:47.744300 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 260/534] 10.222.0.136 () {56 vars in 1107 bytes} [Thu Jul 14 17:04:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:04:47.749944 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6ae042-5d99-434b-8d25-9d8d1d0d13a4 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:47.853054 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:47.856298 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6ae042-5d99-434b-8d25-9d8d1d0d13a4 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:47.893158 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe34fdc-08c8-4ba3-b06b-7280fa5e7d3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:47.894219 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe34fdc-08c8-4ba3-b06b-7280fa5e7d3b None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:47.894873 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe34fdc-08c8-4ba3-b06b-7280fa5e7d3b None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:47.895466 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe34fdc-08c8-4ba3-b06b-7280fa5e7d3b None admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:47.896446 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe34fdc-08c8-4ba3-b06b-7280fa5e7d3b None admin] RBAC: Adding query filter params (name=service) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:04:47.896963 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe34fdc-08c8-4ba3-b06b-7280fa5e7d3b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:47.898557 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe34fdc-08c8-4ba3-b06b-7280fa5e7d3b None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:47.908151 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 275/535] 10.222.0.136 () {56 vars in 1108 bytes} [Thu Jul 14 17:04:47 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:04:47.917086 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7f85f1-d2b0-426c-8012-05e62acb8bd2 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:48.030351 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7f85f1-d2b0-426c-8012-05e62acb8bd2 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:48.068303 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63cecd4-0bf8-4319-8316-cb8f1db9be3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:48.069121 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63cecd4-0bf8-4319-8316-cb8f1db9be3c None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:48.069412 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63cecd4-0bf8-4319-8316-cb8f1db9be3c None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:48.069734 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63cecd4-0bf8-4319-8316-cb8f1db9be3c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:48.080966 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63cecd4-0bf8-4319-8316-cb8f1db9be3c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:48.082534 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63cecd4-0bf8-4319-8316-cb8f1db9be3c None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:48.101035 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-f63cecd4-0bf8-4319-8316-cb8f1db9be3c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:04:48.101035 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:04:48.101035 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:04:48.101035 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:04:48.101035 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:04:48.101035 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:04:48.101035 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:04:48.101035 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:04:48.101035 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:04:48.101035 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:04:48.101035 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:04:48.101035 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:04:48.101035 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 17:04:48.101035 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 17:04:48.101035 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 17:04:48.101975 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 17:04:48.101975 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:04:48.101975 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:04:48.101975 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:04:48.101975 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:04:48.101975 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:04:48.101975 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:04:48.101975 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:04:48.101975 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Jul 14 17:04:48.101975 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:04:48.101975 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:04:48.101975 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:04:48.101975 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:04:48.101975 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:04:48.101975 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:04:48.101975 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:04:48.101975 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:04:48.102825 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 17:04:48.102825 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 17:04:48.102825 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:04:48.102825 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Jul 14 17:04:48.102825 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 261/536] 10.222.0.136 () {56 vars in 1113 bytes} [Thu Jul 14 17:04:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:04:48.108080 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe34fdc-08c8-4ba3-b06b-7280fa5e7d3b None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:48.120069 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25386eda-0aed-412f-8958-258b8c9ee7fe None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:48.120412 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25386eda-0aed-412f-8958-258b8c9ee7fe None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:48.120644 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25386eda-0aed-412f-8958-258b8c9ee7fe None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:48.122478 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 262/537] 10.222.0.136 () {54 vars in 931 bytes} [Thu Jul 14 17:04:48 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:04:48.129783 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d01312-750a-4d36-a69a-39ec50c99833 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:48.130123 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d01312-750a-4d36-a69a-39ec50c99833 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:48.130419 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d01312-750a-4d36-a69a-39ec50c99833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:48.150231 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-a4d01312-750a-4d36-a69a-39ec50c99833 None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:04:48.151448 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-a4d01312-750a-4d36-a69a-39ec50c99833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:04:48.200470 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:48.233635 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 263/538] 10.222.0.136 () {58 vars in 1028 bytes} [Thu Jul 14 17:04:48 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 17:04:48.246475 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe34fdc-08c8-4ba3-b06b-7280fa5e7d3b None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:48.258990 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d01312-750a-4d36-a69a-39ec50c99833 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:48.294415 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74644b6-1a45-46bf-8679-8d5668b4ae3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:48.294997 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74644b6-1a45-46bf-8679-8d5668b4ae3e None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:48.295287 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74644b6-1a45-46bf-8679-8d5668b4ae3e None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:48.295570 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74644b6-1a45-46bf-8679-8d5668b4ae3e None admin] PATH_INFO: `/v3/domains` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:48.296310 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74644b6-1a45-46bf-8679-8d5668b4ae3e None admin] RBAC: Adding query filter params (name=Default) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:04:48.296876 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74644b6-1a45-46bf-8679-8d5668b4ae3e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:48.299091 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74644b6-1a45-46bf-8679-8d5668b4ae3e None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:48.314844 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 276/539] 10.222.0.136 () {56 vars in 1114 bytes} [Thu Jul 14 17:04:48 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:04:48.320761 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060d2368-85d7-4974-8986-735e6a603b6d None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:48.321056 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060d2368-85d7-4974-8986-735e6a603b6d None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:48.321336 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060d2368-85d7-4974-8986-735e6a603b6d None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:48.322929 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 277/540] 10.222.0.136 () {54 vars in 931 bytes} [Thu Jul 14 17:04:48 2022] GET /identity => generated 271 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:04:48.323630 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060d2368-85d7-4974-8986-735e6a603b6d None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:48.356326 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:48.371910 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d01312-750a-4d36-a69a-39ec50c99833 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:48.409819 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fabd15-cb71-4aa8-82a6-80db08406b94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:48.411396 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fabd15-cb71-4aa8-82a6-80db08406b94 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:48.411685 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fabd15-cb71-4aa8-82a6-80db08406b94 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:48.411965 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fabd15-cb71-4aa8-82a6-80db08406b94 None admin] PATH_INFO: `/v3/roles/service` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:48.422904 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fabd15-cb71-4aa8-82a6-80db08406b94 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 17:04:48.431563 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-81fabd15-cb71-4aa8-82a6-80db08406b94 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 17:04:48.431563 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:04:48.431563 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:04:48.431563 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:04:48.431563 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:04:48.431563 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:04:48.431563 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:04:48.431563 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:04:48.431563 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:04:48.431563 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:04:48.431563 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:04:48.431563 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:04:48.431563 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 17:04:48.431563 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 17:04:48.431563 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 17:04:48.431563 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 17:04:48.432651 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 17:04:48.432651 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 17:04:48.432651 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 17:04:48.432651 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 17:04:48.432651 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:04:48.432651 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:04:48.432651 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:04:48.432651 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:04:48.432651 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:04:48.432651 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:04:48.432651 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:04:48.432651 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Jul 14 17:04:48.432651 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:04:48.432651 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:04:48.432651 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:04:48.432651 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:04:48.433967 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:04:48.433967 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:04:48.433967 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:04:48.433967 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:04:48.433967 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 17:04:48.433967 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 17:04:48.433967 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 17:04:48.433967 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 17:04:48.433967 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 17:04:48.433967 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 17:04:48.433967 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 17:04:48.433967 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Jul 14 17:04:48.433967 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 264/541] 10.222.0.136 () {56 vars in 1107 bytes} [Thu Jul 14 17:04:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 17:04:48.438722 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7beba0-a433-414b-9a09-d57a6062ec7a None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:48.439180 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7beba0-a433-414b-9a09-d57a6062ec7a None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:48.439281 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7beba0-a433-414b-9a09-d57a6062ec7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:48.442970 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060d2368-85d7-4974-8986-735e6a603b6d None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:48.456504 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-bf7beba0-a433-414b-9a09-d57a6062ec7a None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:04:48.458744 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-bf7beba0-a433-414b-9a09-d57a6062ec7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:04:48.484437 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d33be7f-38f2-4a12-b69c-4f82479d5e36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:48.485230 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d33be7f-38f2-4a12-b69c-4f82479d5e36 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:48.485515 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d33be7f-38f2-4a12-b69c-4f82479d5e36 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:48.485817 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d33be7f-38f2-4a12-b69c-4f82479d5e36 None admin] PATH_INFO: `/v3/users/nova` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:48.492019 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:48.493939 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d33be7f-38f2-4a12-b69c-4f82479d5e36 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:48.495383 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d33be7f-38f2-4a12-b69c-4f82479d5e36 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:48.511666 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-2d33be7f-38f2-4a12-b69c-4f82479d5e36 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 14 17:04:48.511666 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:04:48.511666 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:04:48.511666 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:04:48.511666 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:04:48.511666 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:04:48.511666 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:04:48.511666 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:04:48.511666 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:04:48.511666 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:04:48.511666 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:04:48.511666 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:04:48.511666 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 17:04:48.511666 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 17:04:48.511666 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 17:04:48.511666 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 17:04:48.512643 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:04:48.512643 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:04:48.512643 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 17:04:48.512643 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 17:04:48.512643 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 17:04:48.512643 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 17:04:48.512643 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:04:48.512643 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:04:48.512643 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:04:48.512643 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:04:48.512643 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:04:48.512643 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Jul 14 17:04:48.512643 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:04:48.512643 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:04:48.512643 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:04:48.512643 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:04:48.512643 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:04:48.512643 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:04:48.514134 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:04:48.514134 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:04:48.514134 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 17:04:48.514134 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 17:04:48.514134 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 17:04:48.514134 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 17:04:48.514134 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 17:04:48.514134 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 17:04:48.514134 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 14 17:04:48.514134 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Jul 14 17:04:48.517874 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 278/542] 10.222.0.136 () {56 vars in 1098 bytes} [Thu Jul 14 17:04:48 2022] GET /identity/v3/users/nova => generated 82 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:04:48.518633 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d33be7f-38f2-4a12-b69c-4f82479d5e36 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:48.541684 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 265/543] 10.222.0.136 () {58 vars in 1028 bytes} [Thu Jul 14 17:04:48 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 17:04:48.541684 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7beba0-a433-414b-9a09-d57a6062ec7a None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:48.613907 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:48.634690 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d33be7f-38f2-4a12-b69c-4f82479d5e36 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:48.656613 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7beba0-a433-414b-9a09-d57a6062ec7a None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:48.673106 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ececac0-d454-41f4-8dcc-a56132cc1c20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:48.673807 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ececac0-d454-41f4-8dcc-a56132cc1c20 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:48.674105 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ececac0-d454-41f4-8dcc-a56132cc1c20 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:48.674519 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ececac0-d454-41f4-8dcc-a56132cc1c20 None admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:48.675304 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ececac0-d454-41f4-8dcc-a56132cc1c20 None admin] RBAC: Adding query filter params (name=service) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:04:48.675553 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ececac0-d454-41f4-8dcc-a56132cc1c20 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:48.677090 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ececac0-d454-41f4-8dcc-a56132cc1c20 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:48.685284 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 279/544] 10.222.0.136 () {56 vars in 1108 bytes} [Thu Jul 14 17:04:48 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:04:48.686106 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ececac0-d454-41f4-8dcc-a56132cc1c20 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:48.693179 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a58739a-86e6-492a-98f4-2a3b19196163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:48.693894 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a58739a-86e6-492a-98f4-2a3b19196163 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:48.694182 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a58739a-86e6-492a-98f4-2a3b19196163 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:48.694462 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a58739a-86e6-492a-98f4-2a3b19196163 None admin] PATH_INFO: `/v3/users` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:48.695292 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a58739a-86e6-492a-98f4-2a3b19196163 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:04:48.695606 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a58739a-86e6-492a-98f4-2a3b19196163 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:48.697033 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a58739a-86e6-492a-98f4-2a3b19196163 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:48.715239 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 266/545] 10.222.0.136 () {56 vars in 1138 bytes} [Thu Jul 14 17:04:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:04:48.716599 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6214b3bb-e33c-42a6-92f7-bdad401c5baa None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:48.716890 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6214b3bb-e33c-42a6-92f7-bdad401c5baa None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:48.717177 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6214b3bb-e33c-42a6-92f7-bdad401c5baa None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:48.718409 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 267/546] 10.222.0.136 () {54 vars in 931 bytes} [Thu Jul 14 17:04:48 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:04:48.719091 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6214b3bb-e33c-42a6-92f7-bdad401c5baa None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:48.747868 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:48.797512 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ececac0-d454-41f4-8dcc-a56132cc1c20 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:48.826525 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6214b3bb-e33c-42a6-92f7-bdad401c5baa None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:48.831702 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e47c9e6-4575-448c-b543-8b5abec93ec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:48.832585 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e47c9e6-4575-448c-b543-8b5abec93ec7 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:48.832935 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e47c9e6-4575-448c-b543-8b5abec93ec7 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:48.833208 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e47c9e6-4575-448c-b543-8b5abec93ec7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:48.843511 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e47c9e6-4575-448c-b543-8b5abec93ec7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 17:04:48.851792 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-1e47c9e6-4575-448c-b543-8b5abec93ec7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 17:04:48.851792 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:04:48.851792 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:04:48.851792 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:04:48.851792 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:04:48.851792 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:04:48.851792 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:04:48.851792 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:04:48.851792 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:04:48.851792 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:04:48.851792 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:04:48.851792 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:04:48.851792 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 17:04:48.851792 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 17:04:48.851792 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 17:04:48.851792 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 17:04:48.852873 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 17:04:48.852873 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 17:04:48.852873 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 17:04:48.852873 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 17:04:48.852873 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:04:48.852873 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:04:48.852873 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:04:48.852873 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:04:48.852873 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:04:48.852873 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:04:48.852873 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:04:48.852873 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Jul 14 17:04:48.852873 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:04:48.852873 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:04:48.852873 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:04:48.852873 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:04:48.853700 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:04:48.853700 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:04:48.853700 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:04:48.853700 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:04:48.853700 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 17:04:48.853700 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 17:04:48.853700 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 17:04:48.853700 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 17:04:48.853700 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 17:04:48.853700 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 17:04:48.853700 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 17:04:48.853700 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Jul 14 17:04:48.853700 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 280/547] 10.222.0.136 () {56 vars in 1107 bytes} [Thu Jul 14 17:04:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:04:48.854375 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e47c9e6-4575-448c-b543-8b5abec93ec7 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:48.858671 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:48.864054 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f380821d-e68d-41bf-bb01-0134c0df47bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:48.864794 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f380821d-e68d-41bf-bb01-0134c0df47bd None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:48.865081 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f380821d-e68d-41bf-bb01-0134c0df47bd None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:48.865368 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f380821d-e68d-41bf-bb01-0134c0df47bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:48.875615 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f380821d-e68d-41bf-bb01-0134c0df47bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:48.877090 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f380821d-e68d-41bf-bb01-0134c0df47bd None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:48.895532 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-f380821d-e68d-41bf-bb01-0134c0df47bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:04:48.895532 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:04:48.895532 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:04:48.895532 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:04:48.895532 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:04:48.895532 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:04:48.895532 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:04:48.895532 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:04:48.895532 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:04:48.895532 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:04:48.895532 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:04:48.895532 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:04:48.895532 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 17:04:48.895532 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 17:04:48.895532 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 17:04:48.896410 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 17:04:48.896410 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:04:48.896410 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:04:48.896410 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:04:48.896410 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:04:48.896410 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:04:48.896410 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:04:48.896410 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:04:48.896410 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Jul 14 17:04:48.896410 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:04:48.896410 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:04:48.896410 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:04:48.896410 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:04:48.896410 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:04:48.896410 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:04:48.896410 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:04:48.896410 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:04:48.897374 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 17:04:48.897374 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 17:04:48.897374 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:04:48.897374 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Jul 14 17:04:48.897374 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 268/548] 10.222.0.136 () {56 vars in 1113 bytes} [Thu Jul 14 17:04:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:04:48.898160 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0037715-6992-4df4-a70a-b386e1bafc4c None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:48.898393 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0037715-6992-4df4-a70a-b386e1bafc4c None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:48.898679 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0037715-6992-4df4-a70a-b386e1bafc4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:48.915736 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-f0037715-6992-4df4-a70a-b386e1bafc4c None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:04:48.916924 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-f0037715-6992-4df4-a70a-b386e1bafc4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:04:48.961607 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e47c9e6-4575-448c-b543-8b5abec93ec7 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:48.989097 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 269/549] 10.222.0.136 () {58 vars in 1028 bytes} [Thu Jul 14 17:04:48 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 17:04:48.990448 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0037715-6992-4df4-a70a-b386e1bafc4c None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:49.001715 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a7d9de-0c6b-415a-b6e3-c7d33aa4fb25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:49.002439 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a7d9de-0c6b-415a-b6e3-c7d33aa4fb25 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:49.003341 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a7d9de-0c6b-415a-b6e3-c7d33aa4fb25 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:49.003341 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a7d9de-0c6b-415a-b6e3-c7d33aa4fb25 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:49.009538 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:49.015974 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a7d9de-0c6b-415a-b6e3-c7d33aa4fb25 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:49.017426 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a7d9de-0c6b-415a-b6e3-c7d33aa4fb25 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:49.035857 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-b2a7d9de-0c6b-415a-b6e3-c7d33aa4fb25 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:04:49.035857 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:04:49.035857 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:04:49.035857 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:04:49.035857 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:04:49.035857 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:04:49.035857 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:04:49.035857 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:04:49.035857 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:04:49.035857 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:04:49.035857 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:04:49.035857 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:04:49.035857 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 17:04:49.035857 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 17:04:49.035857 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 17:04:49.036713 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 17:04:49.036713 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:04:49.036713 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:04:49.036713 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:04:49.036713 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:04:49.036713 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:04:49.036713 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:04:49.036713 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:04:49.036713 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Jul 14 17:04:49.036713 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:04:49.036713 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:04:49.036713 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:04:49.036713 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:04:49.036713 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:04:49.036713 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:04:49.036713 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:04:49.036713 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:04:49.037615 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 17:04:49.037615 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 17:04:49.037615 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:04:49.037615 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Jul 14 17:04:49.037615 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 281/550] 10.222.0.136 () {56 vars in 1113 bytes} [Thu Jul 14 17:04:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:04:49.038059 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a7d9de-0c6b-415a-b6e3-c7d33aa4fb25 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:49.095149 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:49.104542 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0037715-6992-4df4-a70a-b386e1bafc4c None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:49.140227 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9951fc94-0ff3-4527-bd56-7e288fe8574b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:49.140437 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a7d9de-0c6b-415a-b6e3-c7d33aa4fb25 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:49.140898 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9951fc94-0ff3-4527-bd56-7e288fe8574b None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:49.141182 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9951fc94-0ff3-4527-bd56-7e288fe8574b None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:49.141462 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9951fc94-0ff3-4527-bd56-7e288fe8574b None admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:49.142240 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9951fc94-0ff3-4527-bd56-7e288fe8574b None admin] RBAC: Adding query filter params (name=service) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:04:49.142550 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9951fc94-0ff3-4527-bd56-7e288fe8574b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:49.143911 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9951fc94-0ff3-4527-bd56-7e288fe8574b None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:49.151942 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 270/551] 10.222.0.136 () {56 vars in 1108 bytes} [Thu Jul 14 17:04:48 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:04:49.152728 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9951fc94-0ff3-4527-bd56-7e288fe8574b None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:49.178099 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cfd890-670d-49b8-8b76-c36bc93ecac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:49.178763 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cfd890-670d-49b8-8b76-c36bc93ecac0 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:49.179052 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cfd890-670d-49b8-8b76-c36bc93ecac0 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:49.179332 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cfd890-670d-49b8-8b76-c36bc93ecac0 None admin] PATH_INFO: `/v3/domains` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:49.180054 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cfd890-670d-49b8-8b76-c36bc93ecac0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:04:49.180365 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cfd890-670d-49b8-8b76-c36bc93ecac0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:49.181742 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cfd890-670d-49b8-8b76-c36bc93ecac0 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:49.198287 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 282/552] 10.222.0.136 () {56 vars in 1114 bytes} [Thu Jul 14 17:04:49 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:04:49.198287 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cfd890-670d-49b8-8b76-c36bc93ecac0 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:49.224655 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:49.259455 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9951fc94-0ff3-4527-bd56-7e288fe8574b None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:49.293263 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7200aa-e279-45c4-a7b9-62dfdf9f0ccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:49.294090 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7200aa-e279-45c4-a7b9-62dfdf9f0ccb None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:49.294373 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7200aa-e279-45c4-a7b9-62dfdf9f0ccb None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:49.294650 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7200aa-e279-45c4-a7b9-62dfdf9f0ccb None admin] PATH_INFO: `/v3/roles/service` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:49.295766 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cfd890-670d-49b8-8b76-c36bc93ecac0 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:49.304735 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7200aa-e279-45c4-a7b9-62dfdf9f0ccb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 17:04:49.312445 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-2b7200aa-e279-45c4-a7b9-62dfdf9f0ccb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 17:04:49.312445 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:04:49.312445 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:04:49.312445 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:04:49.312445 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:04:49.312445 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:04:49.312445 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:04:49.312445 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:04:49.312445 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:04:49.312445 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:04:49.312445 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:04:49.312445 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:04:49.312445 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 17:04:49.312445 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 17:04:49.312445 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 17:04:49.312445 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 17:04:49.313372 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 17:04:49.313372 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 17:04:49.313372 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 17:04:49.313372 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 17:04:49.313372 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:04:49.313372 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:04:49.313372 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:04:49.313372 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:04:49.313372 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:04:49.313372 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:04:49.313372 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:04:49.313372 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Jul 14 17:04:49.313372 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:04:49.313372 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:04:49.313372 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:04:49.313372 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:04:49.314253 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:04:49.314253 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:04:49.314253 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:04:49.314253 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:04:49.314253 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 17:04:49.314253 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 17:04:49.314253 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 17:04:49.314253 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 17:04:49.314253 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 17:04:49.314253 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 17:04:49.314253 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 17:04:49.314253 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Jul 14 17:04:49.314879 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:49.314951 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 271/553] 10.222.0.136 () {56 vars in 1107 bytes} [Thu Jul 14 17:04:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:04:49.314951 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7200aa-e279-45c4-a7b9-62dfdf9f0ccb None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:49.334162 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4ec1ab-4182-4d06-91d4-cc11827d06b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:49.334820 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4ec1ab-4182-4d06-91d4-cc11827d06b5 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:49.335107 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4ec1ab-4182-4d06-91d4-cc11827d06b5 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:49.335383 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4ec1ab-4182-4d06-91d4-cc11827d06b5 None admin] PATH_INFO: `/v3/domains` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:49.336094 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4ec1ab-4182-4d06-91d4-cc11827d06b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:04:49.336404 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4ec1ab-4182-4d06-91d4-cc11827d06b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:49.337798 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4ec1ab-4182-4d06-91d4-cc11827d06b5 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:49.349642 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 283/554] 10.222.0.136 () {56 vars in 1114 bytes} [Thu Jul 14 17:04:49 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:04:49.350429 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4ec1ab-4182-4d06-91d4-cc11827d06b5 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:49.417681 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7200aa-e279-45c4-a7b9-62dfdf9f0ccb None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:49.444427 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:49.452318 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137060bb-effd-41f3-b00d-ec7e299526cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:49.452583 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4ec1ab-4182-4d06-91d4-cc11827d06b5 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:49.453117 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137060bb-effd-41f3-b00d-ec7e299526cf None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:49.453408 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137060bb-effd-41f3-b00d-ec7e299526cf None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:49.453728 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137060bb-effd-41f3-b00d-ec7e299526cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:49.464891 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137060bb-effd-41f3-b00d-ec7e299526cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:49.466379 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137060bb-effd-41f3-b00d-ec7e299526cf None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:49.483974 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-137060bb-effd-41f3-b00d-ec7e299526cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:04:49.483974 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:04:49.483974 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:04:49.483974 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:04:49.483974 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:04:49.483974 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:04:49.483974 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:04:49.483974 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:04:49.483974 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:04:49.483974 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:04:49.483974 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:04:49.483974 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:04:49.483974 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 17:04:49.483974 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 17:04:49.483974 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 17:04:49.484966 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 17:04:49.484966 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:04:49.484966 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:04:49.484966 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:04:49.484966 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:04:49.484966 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:04:49.484966 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:04:49.484966 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:04:49.484966 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Jul 14 17:04:49.484966 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:04:49.484966 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:04:49.484966 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:04:49.484966 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:04:49.484966 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:04:49.484966 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:04:49.484966 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:04:49.484966 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:04:49.485918 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 17:04:49.485918 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 17:04:49.485918 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:04:49.485918 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Jul 14 17:04:49.485918 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 272/555] 10.222.0.136 () {56 vars in 1113 bytes} [Thu Jul 14 17:04:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:04:49.485918 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137060bb-effd-41f3-b00d-ec7e299526cf None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:49.491532 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b605281f-7f68-48e4-8b30-1046d3e11c00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:49.492334 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b605281f-7f68-48e4-8b30-1046d3e11c00 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:49.492622 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b605281f-7f68-48e4-8b30-1046d3e11c00 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:49.492906 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b605281f-7f68-48e4-8b30-1046d3e11c00 None admin] PATH_INFO: `/v3/users/glance` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:49.500857 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b605281f-7f68-48e4-8b30-1046d3e11c00 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:49.502353 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b605281f-7f68-48e4-8b30-1046d3e11c00 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:49.517230 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-b605281f-7f68-48e4-8b30-1046d3e11c00 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 14 17:04:49.517230 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:04:49.517230 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:04:49.517230 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:04:49.517230 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:04:49.517230 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:04:49.517230 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:04:49.517230 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:04:49.517230 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:04:49.517230 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:04:49.517230 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:04:49.517230 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:04:49.517230 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 17:04:49.517230 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 17:04:49.517230 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 17:04:49.517230 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 17:04:49.518467 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:04:49.518467 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:04:49.518467 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 17:04:49.518467 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 17:04:49.518467 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 17:04:49.518467 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 17:04:49.518467 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:04:49.518467 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:04:49.518467 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:04:49.518467 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:04:49.518467 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:04:49.518467 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Jul 14 17:04:49.518467 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:04:49.518467 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:04:49.518467 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:04:49.518467 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:04:49.518467 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:04:49.518467 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:04:49.519796 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:04:49.519796 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:04:49.519796 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 17:04:49.519796 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 17:04:49.519796 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 17:04:49.519796 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 17:04:49.519796 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 17:04:49.519796 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 17:04:49.519796 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 14 17:04:49.519796 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Jul 14 17:04:49.519796 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 284/556] 10.222.0.136 () {56 vars in 1104 bytes} [Thu Jul 14 17:04:49 2022] GET /identity/v3/users/glance => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:04:49.519796 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b605281f-7f68-48e4-8b30-1046d3e11c00 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:49.557001 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:49.590665 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137060bb-effd-41f3-b00d-ec7e299526cf None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:49.623143 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b605281f-7f68-48e4-8b30-1046d3e11c00 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:49.624856 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c058498-bac7-41f6-8022-311b23bb7bba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:49.625534 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c058498-bac7-41f6-8022-311b23bb7bba None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:49.625854 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c058498-bac7-41f6-8022-311b23bb7bba None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:49.626136 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c058498-bac7-41f6-8022-311b23bb7bba None admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:49.626885 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c058498-bac7-41f6-8022-311b23bb7bba None admin] RBAC: Adding query filter params (name=service) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:04:49.627193 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c058498-bac7-41f6-8022-311b23bb7bba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:49.628581 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c058498-bac7-41f6-8022-311b23bb7bba None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:49.637242 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 273/557] 10.222.0.136 () {56 vars in 1108 bytes} [Thu Jul 14 17:04:49 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:04:49.638075 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c058498-bac7-41f6-8022-311b23bb7bba None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:49.663812 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c531489-f418-4602-9d0f-ee842d3df086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:49.664568 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c531489-f418-4602-9d0f-ee842d3df086 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:49.664855 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c531489-f418-4602-9d0f-ee842d3df086 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:49.665136 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c531489-f418-4602-9d0f-ee842d3df086 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:49.671898 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c531489-f418-4602-9d0f-ee842d3df086 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:49.673270 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c531489-f418-4602-9d0f-ee842d3df086 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:49.682504 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:49.688764 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-8c531489-f418-4602-9d0f-ee842d3df086 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 17:04:49.688764 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:04:49.688764 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:04:49.688764 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:04:49.688764 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:04:49.688764 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:04:49.688764 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:04:49.688764 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:04:49.688764 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:04:49.688764 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:04:49.688764 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:04:49.688764 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:04:49.688764 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 17:04:49.688764 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 17:04:49.688764 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 17:04:49.690386 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 17:04:49.690386 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:04:49.690386 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:04:49.690386 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:04:49.690386 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:04:49.690386 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:04:49.690386 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:04:49.690386 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:04:49.690386 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Jul 14 17:04:49.690386 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:04:49.690386 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:04:49.690386 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:04:49.690386 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:04:49.690386 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:04:49.690386 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:04:49.690386 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:04:49.690386 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:04:49.691268 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 17:04:49.691268 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 17:04:49.691268 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 17:04:49.691268 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 17:04:49.691268 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 17:04:49.691268 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 17:04:49.691268 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 17:04:49.691268 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Jul 14 17:04:49.691268 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 285/558] 10.222.0.136 () {56 vars in 1116 bytes} [Thu Jul 14 17:04:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:04:49.691268 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c531489-f418-4602-9d0f-ee842d3df086 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:49.747708 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c058498-bac7-41f6-8022-311b23bb7bba None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:49.781634 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb26468c-059d-428e-8e4d-c6d3eb4b16a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:49.782301 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb26468c-059d-428e-8e4d-c6d3eb4b16a2 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:49.782580 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb26468c-059d-428e-8e4d-c6d3eb4b16a2 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:49.782857 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb26468c-059d-428e-8e4d-c6d3eb4b16a2 None admin] PATH_INFO: `/v3/domains` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:49.783565 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb26468c-059d-428e-8e4d-c6d3eb4b16a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:04:49.783875 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb26468c-059d-428e-8e4d-c6d3eb4b16a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:49.785991 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb26468c-059d-428e-8e4d-c6d3eb4b16a2 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:49.787750 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:49.793715 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c531489-f418-4602-9d0f-ee842d3df086 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:49.798401 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 274/559] 10.222.0.136 () {56 vars in 1114 bytes} [Thu Jul 14 17:04:49 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:04:49.799241 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb26468c-059d-428e-8e4d-c6d3eb4b16a2 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:49.829224 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b69a9c1-200e-4911-9878-624c44b2cd23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:49.829917 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b69a9c1-200e-4911-9878-624c44b2cd23 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:49.830199 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b69a9c1-200e-4911-9878-624c44b2cd23 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:49.830705 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b69a9c1-200e-4911-9878-624c44b2cd23 None admin] PATH_INFO: `/v3/users` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:49.831377 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b69a9c1-200e-4911-9878-624c44b2cd23 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:04:49.831686 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b69a9c1-200e-4911-9878-624c44b2cd23 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:49.833693 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b69a9c1-200e-4911-9878-624c44b2cd23 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:49.850983 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 286/560] 10.222.0.136 () {56 vars in 1142 bytes} [Thu Jul 14 17:04:49 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 374 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:04:49.851781 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b69a9c1-200e-4911-9878-624c44b2cd23 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:49.899876 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb26468c-059d-428e-8e4d-c6d3eb4b16a2 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:49.901373 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:49.934695 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d212961c-a14f-40db-822d-b4b7601dc80d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:49.935416 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d212961c-a14f-40db-822d-b4b7601dc80d None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:49.935701 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d212961c-a14f-40db-822d-b4b7601dc80d None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:49.935978 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d212961c-a14f-40db-822d-b4b7601dc80d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:49.948698 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d212961c-a14f-40db-822d-b4b7601dc80d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:49.949226 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b69a9c1-200e-4911-9878-624c44b2cd23 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:49.950199 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d212961c-a14f-40db-822d-b4b7601dc80d None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:49.968177 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-d212961c-a14f-40db-822d-b4b7601dc80d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:04:49.968177 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:04:49.968177 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:04:49.968177 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:04:49.968177 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:04:49.968177 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:04:49.968177 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:04:49.968177 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:04:49.968177 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:04:49.968177 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:04:49.968177 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:04:49.968177 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:04:49.968177 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 17:04:49.968177 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 17:04:49.968177 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 17:04:49.969250 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 17:04:49.969250 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:04:49.969250 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:04:49.969250 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:04:49.969250 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:04:49.969250 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:04:49.969250 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:04:49.969250 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:04:49.969250 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Jul 14 17:04:49.969250 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:04:49.969250 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:04:49.969250 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:04:49.969250 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:04:49.969250 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:04:49.969250 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:04:49.969250 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:04:49.969250 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:04:49.970556 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 17:04:49.970556 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 17:04:49.970556 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:04:49.970556 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Jul 14 17:04:49.970556 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 275/561] 10.222.0.136 () {56 vars in 1113 bytes} [Thu Jul 14 17:04:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:04:49.970556 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d212961c-a14f-40db-822d-b4b7601dc80d None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:49.991367 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706ef9f0-f45d-4bff-8195-b84ace87e5ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:49.992028 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706ef9f0-f45d-4bff-8195-b84ace87e5ef None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:49.992314 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706ef9f0-f45d-4bff-8195-b84ace87e5ef None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:49.992593 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706ef9f0-f45d-4bff-8195-b84ace87e5ef None admin] PATH_INFO: `/v3/projects` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:49.993372 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706ef9f0-f45d-4bff-8195-b84ace87e5ef None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:04:49.993727 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706ef9f0-f45d-4bff-8195-b84ace87e5ef None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:49.995156 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706ef9f0-f45d-4bff-8195-b84ace87e5ef None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:50.007693 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 287/562] 10.222.0.136 () {56 vars in 1153 bytes} [Thu Jul 14 17:04:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:04:50.008500 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706ef9f0-f45d-4bff-8195-b84ace87e5ef None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:50.024265 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:50.074566 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d212961c-a14f-40db-822d-b4b7601dc80d None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:50.108411 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd31050-b2b9-4e22-b9cf-3f44c1e54266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:50.109208 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd31050-b2b9-4e22-b9cf-3f44c1e54266 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:50.109308 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706ef9f0-f45d-4bff-8195-b84ace87e5ef None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:50.109492 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd31050-b2b9-4e22-b9cf-3f44c1e54266 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:50.109798 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd31050-b2b9-4e22-b9cf-3f44c1e54266 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:50.117484 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd31050-b2b9-4e22-b9cf-3f44c1e54266 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:50.118951 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd31050-b2b9-4e22-b9cf-3f44c1e54266 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:50.133714 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-ffd31050-b2b9-4e22-b9cf-3f44c1e54266 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 14 17:04:50.133714 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:04:50.133714 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:04:50.133714 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:04:50.133714 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:04:50.133714 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:04:50.133714 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:04:50.133714 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:04:50.133714 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:04:50.133714 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:04:50.133714 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:04:50.133714 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:04:50.133714 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 17:04:50.133714 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 17:04:50.133714 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 17:04:50.133714 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 17:04:50.134832 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:04:50.134832 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:04:50.134832 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 17:04:50.134832 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 17:04:50.134832 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 17:04:50.134832 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 17:04:50.134832 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:04:50.134832 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:04:50.134832 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:04:50.134832 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:04:50.134832 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:04:50.134832 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Jul 14 17:04:50.134832 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:04:50.134832 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:04:50.134832 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:04:50.134832 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:04:50.134832 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:04:50.134832 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:04:50.135778 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:04:50.135778 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:04:50.135778 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 17:04:50.135778 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 17:04:50.135778 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 17:04:50.135778 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 17:04:50.135778 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 17:04:50.135778 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 17:04:50.135778 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 14 17:04:50.135778 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Jul 14 17:04:50.135778 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 276/563] 10.222.0.136 () {56 vars in 1104 bytes} [Thu Jul 14 17:04:49 2022] GET /identity/v3/users/cinder => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:04:50.135778 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd31050-b2b9-4e22-b9cf-3f44c1e54266 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:50.146979 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a511e8c-abc7-499e-a93d-3f757fc3e6eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:50.147775 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a511e8c-abc7-499e-a93d-3f757fc3e6eb None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:50.148058 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a511e8c-abc7-499e-a93d-3f757fc3e6eb None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:50.148335 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a511e8c-abc7-499e-a93d-3f757fc3e6eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:50.152310 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:50.161292 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a511e8c-abc7-499e-a93d-3f757fc3e6eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:50.162769 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a511e8c-abc7-499e-a93d-3f757fc3e6eb None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:50.180194 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-2a511e8c-abc7-499e-a93d-3f757fc3e6eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:04:50.180194 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:04:50.180194 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:04:50.180194 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:04:50.180194 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:04:50.180194 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:04:50.180194 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:04:50.180194 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:04:50.180194 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:04:50.180194 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:04:50.180194 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:04:50.180194 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:04:50.180194 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 17:04:50.180194 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 17:04:50.180194 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 17:04:50.181167 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 17:04:50.181167 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:04:50.181167 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:04:50.181167 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:04:50.181167 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:04:50.181167 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:04:50.181167 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:04:50.181167 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:04:50.181167 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Jul 14 17:04:50.181167 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:04:50.181167 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:04:50.181167 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:04:50.181167 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:04:50.181167 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:04:50.181167 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:04:50.181167 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:04:50.181167 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:04:50.182090 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 17:04:50.182090 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 17:04:50.182090 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:04:50.182090 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Jul 14 17:04:50.182090 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 288/564] 10.222.0.136 () {56 vars in 1113 bytes} [Thu Jul 14 17:04:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:04:50.182370 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a511e8c-abc7-499e-a93d-3f757fc3e6eb None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:50.242833 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd31050-b2b9-4e22-b9cf-3f44c1e54266 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:50.248529 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:50.275751 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a281beb-400a-4f09-96c0-d7cb814d3bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:50.276439 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a281beb-400a-4f09-96c0-d7cb814d3bc8 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:50.276729 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a281beb-400a-4f09-96c0-d7cb814d3bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:50.277015 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a281beb-400a-4f09-96c0-d7cb814d3bc8 None admin] PATH_INFO: `/v3/domains` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:50.277776 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a281beb-400a-4f09-96c0-d7cb814d3bc8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:04:50.278089 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a281beb-400a-4f09-96c0-d7cb814d3bc8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:50.279518 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a281beb-400a-4f09-96c0-d7cb814d3bc8 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:50.283719 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a511e8c-abc7-499e-a93d-3f757fc3e6eb None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:50.291797 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 277/565] 10.222.0.136 () {56 vars in 1114 bytes} [Thu Jul 14 17:04:50 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:04:50.292461 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a281beb-400a-4f09-96c0-d7cb814d3bc8 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:50.324133 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bdb8a9-83ac-4722-bf1c-f5a02d403664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:50.325017 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bdb8a9-83ac-4722-bf1c-f5a02d403664 None admin] REQUEST_METHOD: `PUT` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:50.325300 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bdb8a9-83ac-4722-bf1c-f5a02d403664 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:50.325602 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bdb8a9-83ac-4722-bf1c-f5a02d403664 None admin] PATH_INFO: `/v3/projects/d57eaa6dbca24cbb99dce1fe3437ecae/users/bc2b7d015c2046ddacac6e682f22d0f5/roles/5e0ec7345cc84921907ca95b801a656b` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:50.340381 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bdb8a9-83ac-4722-bf1c-f5a02d403664 None admin] RBAC: Authorizing `identity:create_grant(project_id=d57eaa6dbca24cbb99dce1fe3437ecae, user_id=bc2b7d015c2046ddacac6e682f22d0f5, role_id=5e0ec7345cc84921907ca95b801a656b)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:50.341832 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bdb8a9-83ac-4722-bf1c-f5a02d403664 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:50.354909 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 289/566] 10.222.0.136 () {58 vars in 1444 bytes} [Thu Jul 14 17:04:50 2022] PUT /identity/v3/projects/d57eaa6dbca24cbb99dce1fe3437ecae/users/bc2b7d015c2046ddacac6e682f22d0f5/roles/5e0ec7345cc84921907ca95b801a656b => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:04:50.355967 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bdb8a9-83ac-4722-bf1c-f5a02d403664 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:50.388335 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:50.429654 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a281beb-400a-4f09-96c0-d7cb814d3bc8 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:50.471332 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588a96d2-35e4-49a9-ad28-fc007740b4b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:50.471977 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588a96d2-35e4-49a9-ad28-fc007740b4b9 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:50.472273 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588a96d2-35e4-49a9-ad28-fc007740b4b9 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:50.472495 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588a96d2-35e4-49a9-ad28-fc007740b4b9 None admin] PATH_INFO: `/v3/users` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:50.474110 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588a96d2-35e4-49a9-ad28-fc007740b4b9 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:04:50.474691 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588a96d2-35e4-49a9-ad28-fc007740b4b9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:50.475914 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588a96d2-35e4-49a9-ad28-fc007740b4b9 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:50.481243 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bdb8a9-83ac-4722-bf1c-f5a02d403664 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:50.499195 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 278/567] 10.222.0.136 () {56 vars in 1142 bytes} [Thu Jul 14 17:04:50 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 374 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:04:50.499978 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588a96d2-35e4-49a9-ad28-fc007740b4b9 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:50.505717 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:50.532854 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d51a4d1-5ba4-43e8-994b-78e427b7a5ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:50.533565 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d51a4d1-5ba4-43e8-994b-78e427b7a5ad None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:50.533929 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d51a4d1-5ba4-43e8-994b-78e427b7a5ad None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:50.534211 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d51a4d1-5ba4-43e8-994b-78e427b7a5ad None admin] PATH_INFO: `/v3/domains` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:50.535043 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d51a4d1-5ba4-43e8-994b-78e427b7a5ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:04:50.535900 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d51a4d1-5ba4-43e8-994b-78e427b7a5ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:50.537877 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d51a4d1-5ba4-43e8-994b-78e427b7a5ad None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:50.553134 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 290/568] 10.222.0.136 () {56 vars in 1114 bytes} [Thu Jul 14 17:04:50 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:04:50.554151 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d51a4d1-5ba4-43e8-994b-78e427b7a5ad None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:50.620908 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588a96d2-35e4-49a9-ad28-fc007740b4b9 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:50.652912 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:50.659441 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc64a188-717d-44af-84b8-302e354c6fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:50.660968 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc64a188-717d-44af-84b8-302e354c6fce None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:50.661333 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc64a188-717d-44af-84b8-302e354c6fce None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:50.661776 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc64a188-717d-44af-84b8-302e354c6fce None admin] PATH_INFO: `/v3/users/neutron` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:50.667628 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d51a4d1-5ba4-43e8-994b-78e427b7a5ad None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:50.669130 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc64a188-717d-44af-84b8-302e354c6fce None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:50.670621 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc64a188-717d-44af-84b8-302e354c6fce None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:50.685984 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-dc64a188-717d-44af-84b8-302e354c6fce None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 14 17:04:50.685984 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:04:50.685984 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:04:50.685984 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:04:50.685984 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:04:50.685984 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:04:50.685984 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:04:50.685984 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:04:50.685984 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:04:50.685984 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:04:50.685984 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:04:50.685984 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:04:50.685984 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 17:04:50.685984 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 17:04:50.685984 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 17:04:50.685984 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 17:04:50.687163 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:04:50.687163 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:04:50.687163 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 17:04:50.687163 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 17:04:50.687163 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 17:04:50.687163 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 17:04:50.687163 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:04:50.687163 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:04:50.687163 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:04:50.687163 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:04:50.687163 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:04:50.687163 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Jul 14 17:04:50.687163 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:04:50.687163 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:04:50.687163 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:04:50.687163 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:04:50.687163 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:04:50.687163 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:04:50.692930 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:04:50.692930 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:04:50.692930 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 17:04:50.692930 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 17:04:50.692930 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 17:04:50.692930 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 17:04:50.692930 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 17:04:50.692930 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 17:04:50.692930 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 14 17:04:50.692930 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Jul 14 17:04:50.692930 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 279/569] 10.222.0.136 () {56 vars in 1107 bytes} [Thu Jul 14 17:04:50 2022] GET /identity/v3/users/neutron => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:04:50.692930 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc64a188-717d-44af-84b8-302e354c6fce None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:50.711147 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920fa8b6-27b0-4bb8-950c-4c79dc5358e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:50.712226 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920fa8b6-27b0-4bb8-950c-4c79dc5358e7 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:50.712512 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920fa8b6-27b0-4bb8-950c-4c79dc5358e7 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:50.712790 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920fa8b6-27b0-4bb8-950c-4c79dc5358e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:50.725042 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920fa8b6-27b0-4bb8-950c-4c79dc5358e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:50.726451 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920fa8b6-27b0-4bb8-950c-4c79dc5358e7 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:50.744981 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-920fa8b6-27b0-4bb8-950c-4c79dc5358e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:04:50.744981 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:04:50.744981 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:04:50.744981 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:04:50.744981 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:04:50.744981 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:04:50.744981 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:04:50.744981 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:04:50.744981 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:04:50.744981 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:04:50.744981 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:04:50.744981 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:04:50.744981 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 17:04:50.744981 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 17:04:50.744981 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 17:04:50.746102 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 17:04:50.746102 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:04:50.746102 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:04:50.746102 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:04:50.746102 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:04:50.746102 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:04:50.746102 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:04:50.746102 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:04:50.746102 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Jul 14 17:04:50.746102 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:04:50.746102 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:04:50.746102 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:04:50.746102 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:04:50.746102 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:04:50.746102 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:04:50.746102 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:04:50.746102 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:04:50.747036 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 17:04:50.747036 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 17:04:50.747036 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:04:50.747036 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Jul 14 17:04:50.747036 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 291/570] 10.222.0.136 () {56 vars in 1113 bytes} [Thu Jul 14 17:04:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:04:50.747450 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920fa8b6-27b0-4bb8-950c-4c79dc5358e7 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:50.781672 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:50.809455 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc64a188-717d-44af-84b8-302e354c6fce None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:50.855230 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3b12bd-7c60-4eb9-bbf0-ae7848764255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:50.856303 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3b12bd-7c60-4eb9-bbf0-ae7848764255 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:50.856590 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3b12bd-7c60-4eb9-bbf0-ae7848764255 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:50.856956 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3b12bd-7c60-4eb9-bbf0-ae7848764255 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:50.863704 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920fa8b6-27b0-4bb8-950c-4c79dc5358e7 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:50.864180 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3b12bd-7c60-4eb9-bbf0-ae7848764255 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:50.865673 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3b12bd-7c60-4eb9-bbf0-ae7848764255 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:50.880234 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-ab3b12bd-7c60-4eb9-bbf0-ae7848764255 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 17:04:50.880234 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:04:50.880234 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:04:50.880234 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:04:50.880234 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:04:50.880234 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:04:50.880234 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:04:50.880234 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:04:50.880234 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:04:50.880234 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:04:50.880234 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:04:50.880234 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:04:50.880234 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 17:04:50.880234 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 17:04:50.880234 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 17:04:50.881381 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 17:04:50.881381 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:04:50.881381 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:04:50.881381 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:04:50.881381 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:04:50.881381 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:04:50.881381 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:04:50.881381 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:04:50.881381 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Jul 14 17:04:50.881381 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:04:50.881381 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:04:50.881381 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:04:50.881381 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:04:50.881381 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:04:50.881381 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:04:50.881381 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:04:50.881381 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:04:50.882389 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 17:04:50.882389 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 17:04:50.882389 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 17:04:50.882389 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 17:04:50.882389 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 17:04:50.882389 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 17:04:50.882389 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 17:04:50.882389 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Jul 14 17:04:50.882389 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 280/571] 10.222.0.136 () {56 vars in 1116 bytes} [Thu Jul 14 17:04:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:04:50.882906 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3b12bd-7c60-4eb9-bbf0-ae7848764255 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:50.906563 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c30b82-cb12-4218-9f67-a40616392991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:50.907236 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c30b82-cb12-4218-9f67-a40616392991 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:50.907526 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c30b82-cb12-4218-9f67-a40616392991 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:50.908178 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c30b82-cb12-4218-9f67-a40616392991 None admin] PATH_INFO: `/v3/users` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:50.908634 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c30b82-cb12-4218-9f67-a40616392991 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:04:50.908946 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c30b82-cb12-4218-9f67-a40616392991 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:50.910945 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c30b82-cb12-4218-9f67-a40616392991 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:50.930185 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 292/572] 10.222.0.136 () {56 vars in 1144 bytes} [Thu Jul 14 17:04:50 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 376 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:04:50.935329 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c30b82-cb12-4218-9f67-a40616392991 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:50.943486 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:51.001869 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3b12bd-7c60-4eb9-bbf0-ae7848764255 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:51.036179 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:51.045402 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e287af85-5c54-4d88-a0a9-6dfbd9471017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:51.046098 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e287af85-5c54-4d88-a0a9-6dfbd9471017 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:51.046382 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e287af85-5c54-4d88-a0a9-6dfbd9471017 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:51.046657 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e287af85-5c54-4d88-a0a9-6dfbd9471017 None admin] PATH_INFO: `/v3/domains` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:51.047377 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e287af85-5c54-4d88-a0a9-6dfbd9471017 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:04:51.047681 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e287af85-5c54-4d88-a0a9-6dfbd9471017 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:51.049049 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e287af85-5c54-4d88-a0a9-6dfbd9471017 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:51.053252 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c30b82-cb12-4218-9f67-a40616392991 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:51.065992 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 281/573] 10.222.0.136 () {56 vars in 1114 bytes} [Thu Jul 14 17:04:50 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:04:51.065992 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e287af85-5c54-4d88-a0a9-6dfbd9471017 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:51.096813 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf050f1-01f1-4648-88d8-d707c6a2cb9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:51.097477 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf050f1-01f1-4648-88d8-d707c6a2cb9e None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:51.098587 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf050f1-01f1-4648-88d8-d707c6a2cb9e None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:51.098878 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf050f1-01f1-4648-88d8-d707c6a2cb9e None admin] PATH_INFO: `/v3/projects` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:51.099676 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf050f1-01f1-4648-88d8-d707c6a2cb9e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:04:51.100002 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf050f1-01f1-4648-88d8-d707c6a2cb9e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:51.101448 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf050f1-01f1-4648-88d8-d707c6a2cb9e None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:51.115540 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 293/574] 10.222.0.136 () {56 vars in 1153 bytes} [Thu Jul 14 17:04:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:04:51.115540 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf050f1-01f1-4648-88d8-d707c6a2cb9e None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:51.183803 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e287af85-5c54-4d88-a0a9-6dfbd9471017 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:51.199107 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:51.224731 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84db5d3-cd19-412c-b3d3-3983513a39ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:51.225902 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84db5d3-cd19-412c-b3d3-3983513a39ba None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:51.226197 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84db5d3-cd19-412c-b3d3-3983513a39ba None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:51.226485 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84db5d3-cd19-412c-b3d3-3983513a39ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:51.233770 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf050f1-01f1-4648-88d8-d707c6a2cb9e None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:51.239027 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84db5d3-cd19-412c-b3d3-3983513a39ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:51.240495 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84db5d3-cd19-412c-b3d3-3983513a39ba None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:51.259232 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-e84db5d3-cd19-412c-b3d3-3983513a39ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:04:51.259232 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:04:51.259232 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:04:51.259232 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:04:51.259232 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:04:51.259232 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:04:51.259232 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:04:51.259232 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:04:51.259232 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:04:51.259232 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:04:51.259232 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:04:51.259232 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:04:51.259232 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 17:04:51.259232 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 17:04:51.259232 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 17:04:51.260124 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 17:04:51.260124 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:04:51.260124 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:04:51.260124 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:04:51.260124 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:04:51.260124 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:04:51.260124 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:04:51.260124 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:04:51.260124 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Jul 14 17:04:51.260124 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:04:51.260124 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:04:51.260124 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:04:51.260124 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:04:51.260124 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:04:51.260124 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:04:51.260124 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:04:51.260124 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:04:51.261045 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 17:04:51.261045 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 17:04:51.261045 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:04:51.261045 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Jul 14 17:04:51.264818 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 282/575] 10.222.0.136 () {56 vars in 1113 bytes} [Thu Jul 14 17:04:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:04:51.265604 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84db5d3-cd19-412c-b3d3-3983513a39ba None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:51.272811 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa92292-e499-4d96-bb08-f0478f38dc3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:51.273629 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa92292-e499-4d96-bb08-f0478f38dc3b None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:51.273914 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa92292-e499-4d96-bb08-f0478f38dc3b None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:51.274448 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa92292-e499-4d96-bb08-f0478f38dc3b None admin] PATH_INFO: `/v3/projects/service` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:51.281663 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa92292-e499-4d96-bb08-f0478f38dc3b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:51.283094 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa92292-e499-4d96-bb08-f0478f38dc3b None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:51.297900 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-7fa92292-e499-4d96-bb08-f0478f38dc3b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 17:04:51.297900 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:04:51.297900 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:04:51.297900 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:04:51.297900 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:04:51.297900 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:04:51.297900 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:04:51.297900 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:04:51.297900 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:04:51.297900 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:04:51.297900 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:04:51.297900 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:04:51.297900 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 17:04:51.297900 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 17:04:51.297900 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 17:04:51.298799 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 17:04:51.298799 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:04:51.298799 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:04:51.298799 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:04:51.298799 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:04:51.298799 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:04:51.298799 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:04:51.298799 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:04:51.298799 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Jul 14 17:04:51.298799 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:04:51.298799 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:04:51.298799 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:04:51.298799 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:04:51.298799 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:04:51.298799 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:04:51.298799 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:04:51.298799 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:04:51.299692 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 17:04:51.299692 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 17:04:51.299692 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 17:04:51.299692 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 17:04:51.299692 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 17:04:51.299692 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 17:04:51.299692 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 17:04:51.299692 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Jul 14 17:04:51.299692 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 294/576] 10.222.0.136 () {56 vars in 1116 bytes} [Thu Jul 14 17:04:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:04:51.300181 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa92292-e499-4d96-bb08-f0478f38dc3b None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:51.310999 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:51.387014 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84db5d3-cd19-412c-b3d3-3983513a39ba None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:51.411122 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa92292-e499-4d96-bb08-f0478f38dc3b None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:51.423760 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24118d7-eeb0-4a5d-a1e2-2990b9ad8c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:51.424654 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24118d7-eeb0-4a5d-a1e2-2990b9ad8c12 None admin] REQUEST_METHOD: `PUT` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:51.424960 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24118d7-eeb0-4a5d-a1e2-2990b9ad8c12 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:51.425213 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24118d7-eeb0-4a5d-a1e2-2990b9ad8c12 None admin] PATH_INFO: `/v3/projects/d57eaa6dbca24cbb99dce1fe3437ecae/users/c2c3d46d376c460a99426a5dc7c66115/roles/5e0ec7345cc84921907ca95b801a656b` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:51.442126 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24118d7-eeb0-4a5d-a1e2-2990b9ad8c12 None admin] RBAC: Authorizing `identity:create_grant(project_id=d57eaa6dbca24cbb99dce1fe3437ecae, user_id=c2c3d46d376c460a99426a5dc7c66115, role_id=5e0ec7345cc84921907ca95b801a656b)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:51.443585 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24118d7-eeb0-4a5d-a1e2-2990b9ad8c12 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:51.447909 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfe55ba-9302-4237-b714-21be887d1c7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:51.448671 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfe55ba-9302-4237-b714-21be887d1c7d None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:51.448958 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfe55ba-9302-4237-b714-21be887d1c7d None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:51.449338 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfe55ba-9302-4237-b714-21be887d1c7d None admin] PATH_INFO: `/v3/domains` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:51.450112 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfe55ba-9302-4237-b714-21be887d1c7d None admin] RBAC: Adding query filter params (name=Default) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:04:51.450459 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfe55ba-9302-4237-b714-21be887d1c7d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:51.451914 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfe55ba-9302-4237-b714-21be887d1c7d None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:51.465574 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 283/577] 10.222.0.136 () {58 vars in 1444 bytes} [Thu Jul 14 17:04:51 2022] PUT /identity/v3/projects/d57eaa6dbca24cbb99dce1fe3437ecae/users/c2c3d46d376c460a99426a5dc7c66115/roles/5e0ec7345cc84921907ca95b801a656b => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:04:51.465574 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24118d7-eeb0-4a5d-a1e2-2990b9ad8c12 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:51.475344 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 295/578] 10.222.0.136 () {56 vars in 1114 bytes} [Thu Jul 14 17:04:51 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:04:51.482718 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfe55ba-9302-4237-b714-21be887d1c7d None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:51.485098 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:51.566010 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:51.600567 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24118d7-eeb0-4a5d-a1e2-2990b9ad8c12 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:51.620135 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfe55ba-9302-4237-b714-21be887d1c7d None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:51.650911 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8313558-aac0-48b3-ba3a-a76c52650d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:51.652291 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8313558-aac0-48b3-ba3a-a76c52650d02 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:51.652594 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8313558-aac0-48b3-ba3a-a76c52650d02 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:51.652958 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8313558-aac0-48b3-ba3a-a76c52650d02 None admin] PATH_INFO: `/v3/projects` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:51.653799 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8313558-aac0-48b3-ba3a-a76c52650d02 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:04:51.654282 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8313558-aac0-48b3-ba3a-a76c52650d02 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:51.656346 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8313558-aac0-48b3-ba3a-a76c52650d02 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:51.671102 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dac0ec-9f2c-4d4f-84d2-f58c586446aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:51.672223 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dac0ec-9f2c-4d4f-84d2-f58c586446aa None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:51.677505 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 284/579] 10.222.0.136 () {56 vars in 1153 bytes} [Thu Jul 14 17:04:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:04:51.677675 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dac0ec-9f2c-4d4f-84d2-f58c586446aa None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:51.677675 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dac0ec-9f2c-4d4f-84d2-f58c586446aa None admin] PATH_INFO: `/v3/projects/service` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:51.679216 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8313558-aac0-48b3-ba3a-a76c52650d02 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:51.688924 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dac0ec-9f2c-4d4f-84d2-f58c586446aa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:51.690446 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dac0ec-9f2c-4d4f-84d2-f58c586446aa None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:51.708587 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-62dac0ec-9f2c-4d4f-84d2-f58c586446aa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 17:04:51.708587 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:04:51.708587 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:04:51.708587 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:04:51.708587 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:04:51.708587 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:04:51.708587 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:04:51.708587 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:04:51.708587 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:04:51.708587 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:04:51.708587 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:04:51.708587 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:04:51.708587 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 17:04:51.708587 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 17:04:51.708587 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 17:04:51.709672 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 17:04:51.709672 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:04:51.709672 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:04:51.709672 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:04:51.709672 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:04:51.709672 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:04:51.709672 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:04:51.709672 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:04:51.709672 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Jul 14 17:04:51.709672 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:04:51.709672 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:04:51.709672 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:04:51.709672 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:04:51.709672 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:04:51.709672 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:04:51.709672 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:04:51.709672 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:04:51.710741 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 17:04:51.710741 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 17:04:51.710741 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 17:04:51.710741 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 17:04:51.710741 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 17:04:51.710741 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 17:04:51.710741 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 17:04:51.710741 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Jul 14 17:04:51.710741 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 296/580] 10.222.0.136 () {56 vars in 1116 bytes} [Thu Jul 14 17:04:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:04:51.717380 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dac0ec-9f2c-4d4f-84d2-f58c586446aa None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:51.777328 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:51.811860 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8313558-aac0-48b3-ba3a-a76c52650d02 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:51.838853 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dac0ec-9f2c-4d4f-84d2-f58c586446aa None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:51.857238 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53d4975-28a3-4887-b6c6-054658b4a11c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:51.858222 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53d4975-28a3-4887-b6c6-054658b4a11c None admin] REQUEST_METHOD: `PUT` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:51.858507 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53d4975-28a3-4887-b6c6-054658b4a11c None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:51.858956 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53d4975-28a3-4887-b6c6-054658b4a11c None admin] PATH_INFO: `/v3/projects/d57eaa6dbca24cbb99dce1fe3437ecae/users/5fc301707c5d4f759b61266af952e625/roles/5e0ec7345cc84921907ca95b801a656b` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:51.872936 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:51.881920 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53d4975-28a3-4887-b6c6-054658b4a11c None admin] RBAC: Authorizing `identity:create_grant(project_id=d57eaa6dbca24cbb99dce1fe3437ecae, user_id=5fc301707c5d4f759b61266af952e625, role_id=5e0ec7345cc84921907ca95b801a656b)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:51.883702 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e814d9c3-1fcf-40a7-a3bc-f93f887185fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:51.884188 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53d4975-28a3-4887-b6c6-054658b4a11c None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:51.884390 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e814d9c3-1fcf-40a7-a3bc-f93f887185fd None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:51.884639 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e814d9c3-1fcf-40a7-a3bc-f93f887185fd None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:51.884914 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e814d9c3-1fcf-40a7-a3bc-f93f887185fd None admin] PATH_INFO: `/v3/projects` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:51.885784 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e814d9c3-1fcf-40a7-a3bc-f93f887185fd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:04:51.886097 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e814d9c3-1fcf-40a7-a3bc-f93f887185fd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:51.887579 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e814d9c3-1fcf-40a7-a3bc-f93f887185fd None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:51.906621 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 297/581] 10.222.0.136 () {56 vars in 1153 bytes} [Thu Jul 14 17:04:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 17:04:51.907795 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 285/582] 10.222.0.136 () {58 vars in 1444 bytes} [Thu Jul 14 17:04:51 2022] PUT /identity/v3/projects/d57eaa6dbca24cbb99dce1fe3437ecae/users/5fc301707c5d4f759b61266af952e625/roles/5e0ec7345cc84921907ca95b801a656b => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:04:51.908723 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e814d9c3-1fcf-40a7-a3bc-f93f887185fd None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:52.028651 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e814d9c3-1fcf-40a7-a3bc-f93f887185fd None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:52.071504 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381f1f88-bf3b-4c4b-ae20-28b9eca1b036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:52.072414 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381f1f88-bf3b-4c4b-ae20-28b9eca1b036 None admin] REQUEST_METHOD: `PUT` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:52.072695 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381f1f88-bf3b-4c4b-ae20-28b9eca1b036 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:52.072967 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381f1f88-bf3b-4c4b-ae20-28b9eca1b036 None admin] PATH_INFO: `/v3/projects/d57eaa6dbca24cbb99dce1fe3437ecae/users/a8c6871e11f047e284afdb16bcb1d3a4/roles/5e0ec7345cc84921907ca95b801a656b` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:52.090237 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381f1f88-bf3b-4c4b-ae20-28b9eca1b036 None admin] RBAC: Authorizing `identity:create_grant(project_id=d57eaa6dbca24cbb99dce1fe3437ecae, user_id=a8c6871e11f047e284afdb16bcb1d3a4, role_id=5e0ec7345cc84921907ca95b801a656b)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:52.092497 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381f1f88-bf3b-4c4b-ae20-28b9eca1b036 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:52.108744 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 298/583] 10.222.0.136 () {58 vars in 1444 bytes} [Thu Jul 14 17:04:51 2022] PUT /identity/v3/projects/d57eaa6dbca24cbb99dce1fe3437ecae/users/a8c6871e11f047e284afdb16bcb1d3a4/roles/5e0ec7345cc84921907ca95b801a656b => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:04:52.907216 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e7c863-c60c-4491-a98d-b54850917ae5 None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:52.908056 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e7c863-c60c-4491-a98d-b54850917ae5 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:52.908212 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e7c863-c60c-4491-a98d-b54850917ae5 None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:52.911129 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 286/584] 10.222.0.136 () {54 vars in 931 bytes} [Thu Jul 14 17:04:52 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 14 17:04:52.919450 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afd8267-34e6-4df0-9024-f8ea36a98efd None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:52.920133 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afd8267-34e6-4df0-9024-f8ea36a98efd None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:52.920433 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afd8267-34e6-4df0-9024-f8ea36a98efd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:52.947931 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-1afd8267-34e6-4df0-9024-f8ea36a98efd None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:04:52.949898 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-1afd8267-34e6-4df0-9024-f8ea36a98efd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:04:52.999405 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:53.051484 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 299/585] 10.222.0.136 () {58 vars in 1028 bytes} [Thu Jul 14 17:04:52 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 17:04:53.076145 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e7c863-c60c-4491-a98d-b54850917ae5 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:53.193246 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e7c863-c60c-4491-a98d-b54850917ae5 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:53.219430 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:53.231841 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ae220a-fe1f-471b-b341-970b1c4eecbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:53.232664 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ae220a-fe1f-471b-b341-970b1c4eecbc None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:53.232951 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ae220a-fe1f-471b-b341-970b1c4eecbc None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:53.233234 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ae220a-fe1f-471b-b341-970b1c4eecbc None admin] PATH_INFO: `/v3/roles/service` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:53.244284 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ae220a-fe1f-471b-b341-970b1c4eecbc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 17:04:53.251994 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-73ae220a-fe1f-471b-b341-970b1c4eecbc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 17:04:53.251994 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:04:53.251994 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:04:53.251994 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:04:53.251994 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:04:53.251994 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:04:53.251994 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:04:53.251994 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:04:53.251994 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:04:53.251994 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:04:53.251994 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:04:53.251994 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:04:53.251994 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 17:04:53.251994 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 17:04:53.251994 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 17:04:53.251994 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 17:04:53.253112 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 17:04:53.253112 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 17:04:53.253112 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 17:04:53.253112 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 17:04:53.253112 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:04:53.253112 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:04:53.253112 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:04:53.253112 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:04:53.253112 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:04:53.253112 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:04:53.253112 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:04:53.253112 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Jul 14 17:04:53.253112 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:04:53.253112 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:04:53.253112 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:04:53.253112 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:04:53.254644 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:04:53.254644 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:04:53.254644 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:04:53.254644 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:04:53.254644 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 17:04:53.254644 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 17:04:53.254644 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 17:04:53.254644 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 17:04:53.254644 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 17:04:53.254644 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 17:04:53.254644 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 17:04:53.254644 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Jul 14 17:04:53.257867 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 287/586] 10.222.0.136 () {56 vars in 1107 bytes} [Thu Jul 14 17:04:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:04:53.260116 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afd8267-34e6-4df0-9024-f8ea36a98efd None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:53.366209 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afd8267-34e6-4df0-9024-f8ea36a98efd None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:53.406461 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d65e670-24e8-4789-be12-7923e690b7a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:53.407128 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d65e670-24e8-4789-be12-7923e690b7a9 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:53.407413 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d65e670-24e8-4789-be12-7923e690b7a9 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:53.407684 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d65e670-24e8-4789-be12-7923e690b7a9 None admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:53.408468 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d65e670-24e8-4789-be12-7923e690b7a9 None admin] RBAC: Adding query filter params (name=service) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:04:53.408932 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d65e670-24e8-4789-be12-7923e690b7a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:53.410682 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d65e670-24e8-4789-be12-7923e690b7a9 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:53.419723 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 300/587] 10.222.0.136 () {56 vars in 1108 bytes} [Thu Jul 14 17:04:53 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:04:53.425135 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ae220a-fe1f-471b-b341-970b1c4eecbc None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:53.530979 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ae220a-fe1f-471b-b341-970b1c4eecbc None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:53.566288 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1928ede1-690e-4d8d-b5dd-0656b8b948ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:53.567322 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1928ede1-690e-4d8d-b5dd-0656b8b948ec None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:53.567606 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1928ede1-690e-4d8d-b5dd-0656b8b948ec None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:53.567883 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1928ede1-690e-4d8d-b5dd-0656b8b948ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:53.579641 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1928ede1-690e-4d8d-b5dd-0656b8b948ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:53.581169 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1928ede1-690e-4d8d-b5dd-0656b8b948ec None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:53.599251 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-1928ede1-690e-4d8d-b5dd-0656b8b948ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:04:53.599251 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:04:53.599251 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:04:53.599251 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:04:53.599251 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:04:53.599251 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:04:53.599251 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:04:53.599251 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:04:53.599251 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:04:53.599251 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:04:53.599251 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:04:53.599251 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:04:53.599251 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 17:04:53.599251 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 17:04:53.599251 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 17:04:53.601317 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 17:04:53.601317 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:04:53.601317 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:04:53.601317 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:04:53.601317 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:04:53.601317 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:04:53.601317 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:04:53.601317 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:04:53.601317 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Jul 14 17:04:53.601317 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:04:53.601317 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:04:53.601317 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:04:53.601317 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:04:53.601317 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:04:53.601317 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:04:53.601317 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:04:53.601317 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:04:53.603464 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 17:04:53.603464 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 17:04:53.603464 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:04:53.603464 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Jul 14 17:04:53.603464 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 288/588] 10.222.0.136 () {56 vars in 1113 bytes} [Thu Jul 14 17:04:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:04:53.606520 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d65e670-24e8-4789-be12-7923e690b7a9 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:53.639696 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:53.725593 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d65e670-24e8-4789-be12-7923e690b7a9 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:53.766304 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8a5421-e7e5-4243-b340-a46275a02470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:53.766974 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8a5421-e7e5-4243-b340-a46275a02470 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:53.767989 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8a5421-e7e5-4243-b340-a46275a02470 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:53.767989 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8a5421-e7e5-4243-b340-a46275a02470 None admin] PATH_INFO: `/v3/domains` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:53.768292 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8a5421-e7e5-4243-b340-a46275a02470 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:04:53.768526 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8a5421-e7e5-4243-b340-a46275a02470 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:53.770917 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8a5421-e7e5-4243-b340-a46275a02470 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:53.784478 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 301/589] 10.222.0.136 () {56 vars in 1114 bytes} [Thu Jul 14 17:04:53 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:04:53.790197 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1928ede1-690e-4d8d-b5dd-0656b8b948ec None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:53.858201 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:53.898339 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1928ede1-690e-4d8d-b5dd-0656b8b948ec None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:53.905231 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b839d96-777b-4033-aac6-5b72f4d3a7bb None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:53.905815 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b839d96-777b-4033-aac6-5b72f4d3a7bb None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:53.906318 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b839d96-777b-4033-aac6-5b72f4d3a7bb None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:53.908142 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 302/590] 10.222.0.136 () {54 vars in 931 bytes} [Thu Jul 14 17:04:53 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:04:53.914023 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb4c057-65b9-4c55-a86e-30cb85f73a14 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:53.914613 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb4c057-65b9-4c55-a86e-30cb85f73a14 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:53.915102 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb4c057-65b9-4c55-a86e-30cb85f73a14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:53.932163 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-5cb4c057-65b9-4c55-a86e-30cb85f73a14 None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:04:53.934440 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-5cb4c057-65b9-4c55-a86e-30cb85f73a14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:04:53.935931 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b08795-59cd-4ea8-9ab9-ba8962cb1eaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:53.936729 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b08795-59cd-4ea8-9ab9-ba8962cb1eaf None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:53.937020 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b08795-59cd-4ea8-9ab9-ba8962cb1eaf None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:53.937300 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b08795-59cd-4ea8-9ab9-ba8962cb1eaf None admin] PATH_INFO: `/v3/users/nova` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:53.948074 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b08795-59cd-4ea8-9ab9-ba8962cb1eaf None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:53.950022 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b08795-59cd-4ea8-9ab9-ba8962cb1eaf None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:53.969474 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-e8b08795-59cd-4ea8-9ab9-ba8962cb1eaf None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 14 17:04:53.969474 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:04:53.969474 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:04:53.969474 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:04:53.969474 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:04:53.969474 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:04:53.969474 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:04:53.969474 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:04:53.969474 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:04:53.969474 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:04:53.969474 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:04:53.969474 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:04:53.969474 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 17:04:53.969474 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 17:04:53.969474 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 17:04:53.969474 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 17:04:53.970469 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:04:53.970469 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:04:53.970469 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 17:04:53.970469 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 17:04:53.970469 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 17:04:53.970469 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 17:04:53.970469 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:04:53.970469 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:04:53.970469 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:04:53.970469 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:04:53.970469 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:04:53.970469 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Jul 14 17:04:53.970469 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:04:53.970469 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:04:53.970469 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:04:53.970469 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:04:53.970469 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:04:53.970469 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:04:53.971508 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:04:53.971508 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:04:53.971508 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 17:04:53.971508 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 17:04:53.971508 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 17:04:53.971508 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 17:04:53.971508 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 17:04:53.971508 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 17:04:53.971508 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 14 17:04:53.971508 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Jul 14 17:04:53.971508 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 289/591] 10.222.0.136 () {56 vars in 1098 bytes} [Thu Jul 14 17:04:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:04:53.977073 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b08795-59cd-4ea8-9ab9-ba8962cb1eaf None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:54.021698 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 303/592] 10.222.0.136 () {58 vars in 1028 bytes} [Thu Jul 14 17:04:53 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 17:04:54.041915 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb4c057-65b9-4c55-a86e-30cb85f73a14 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:54.063503 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:54.087245 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b08795-59cd-4ea8-9ab9-ba8962cb1eaf None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:54.098630 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:54.134304 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f149fdea-a458-472d-a298-b666600420cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:54.135666 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f149fdea-a458-472d-a298-b666600420cc None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:54.135666 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f149fdea-a458-472d-a298-b666600420cc None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:54.135666 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f149fdea-a458-472d-a298-b666600420cc None admin] PATH_INFO: `/v3/users` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:54.136358 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f149fdea-a458-472d-a298-b666600420cc None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:04:54.136667 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f149fdea-a458-472d-a298-b666600420cc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:54.138167 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f149fdea-a458-472d-a298-b666600420cc None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:54.159938 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 290/593] 10.222.0.136 () {56 vars in 1138 bytes} [Thu Jul 14 17:04:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 17:04:54.166125 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f149fdea-a458-472d-a298-b666600420cc None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:54.169895 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb4c057-65b9-4c55-a86e-30cb85f73a14 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:54.220203 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552228be-994a-42a3-82f5-f285f5792844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:54.221291 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552228be-994a-42a3-82f5-f285f5792844 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:54.221820 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552228be-994a-42a3-82f5-f285f5792844 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:54.222302 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552228be-994a-42a3-82f5-f285f5792844 None admin] PATH_INFO: `/v3/roles/service` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:54.235123 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552228be-994a-42a3-82f5-f285f5792844 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 17:04:54.243492 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-552228be-994a-42a3-82f5-f285f5792844 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 17:04:54.243492 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:04:54.243492 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:04:54.243492 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:04:54.243492 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:04:54.243492 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:04:54.243492 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:04:54.243492 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:04:54.243492 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:04:54.243492 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:04:54.243492 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:04:54.243492 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:04:54.243492 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 17:04:54.243492 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 17:04:54.243492 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 17:04:54.243492 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 17:04:54.244481 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 17:04:54.244481 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 17:04:54.244481 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 17:04:54.244481 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 17:04:54.244481 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:04:54.244481 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:04:54.244481 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:04:54.244481 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:04:54.244481 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:04:54.244481 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:04:54.244481 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:04:54.244481 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Jul 14 17:04:54.244481 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:04:54.244481 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:04:54.244481 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:04:54.244481 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:04:54.245334 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:04:54.245334 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:04:54.245334 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:04:54.245334 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:04:54.245334 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 17:04:54.245334 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 17:04:54.245334 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 17:04:54.245334 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 17:04:54.245334 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 17:04:54.245334 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 17:04:54.245334 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 17:04:54.245334 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Jul 14 17:04:54.247051 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 304/594] 10.222.0.136 () {56 vars in 1107 bytes} [Thu Jul 14 17:04:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:04:54.254876 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552228be-994a-42a3-82f5-f285f5792844 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:54.276543 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f149fdea-a458-472d-a298-b666600420cc None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:54.313950 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513d3575-665d-4f09-aa60-a06764c1311a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:54.314531 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513d3575-665d-4f09-aa60-a06764c1311a None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:54.315083 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513d3575-665d-4f09-aa60-a06764c1311a None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:54.315205 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513d3575-665d-4f09-aa60-a06764c1311a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:54.340659 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:54.344179 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:54.365201 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552228be-994a-42a3-82f5-f285f5792844 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:54.394042 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513d3575-665d-4f09-aa60-a06764c1311a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:54.396060 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513d3575-665d-4f09-aa60-a06764c1311a None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:54.399459 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7078f7-d2f5-4af1-9b44-57edc65f58f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:54.400122 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7078f7-d2f5-4af1-9b44-57edc65f58f6 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:54.400404 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7078f7-d2f5-4af1-9b44-57edc65f58f6 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:54.400678 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7078f7-d2f5-4af1-9b44-57edc65f58f6 None admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:54.401425 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7078f7-d2f5-4af1-9b44-57edc65f58f6 None admin] RBAC: Adding query filter params (name=service) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:04:54.401762 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7078f7-d2f5-4af1-9b44-57edc65f58f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:54.403115 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7078f7-d2f5-4af1-9b44-57edc65f58f6 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:54.411915 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 305/595] 10.222.0.136 () {56 vars in 1108 bytes} [Thu Jul 14 17:04:54 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:04:54.411915 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d566303e-3c9b-40cf-9a06-5dbcbe240132 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:54.411915 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d566303e-3c9b-40cf-9a06-5dbcbe240132 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:54.411915 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d566303e-3c9b-40cf-9a06-5dbcbe240132 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:54.411915 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 306/596] 10.222.0.136 () {54 vars in 931 bytes} [Thu Jul 14 17:04:54 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:04:54.418832 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d566303e-3c9b-40cf-9a06-5dbcbe240132 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:54.517447 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 291/597] 10.222.0.136 () {58 vars in 1287 bytes} [Thu Jul 14 17:04:54 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 17:04:54.517447 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe38c2a5-3202-4c3c-b923-c3fff52ee7f7 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:54.517447 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe38c2a5-3202-4c3c-b923-c3fff52ee7f7 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:54.517447 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe38c2a5-3202-4c3c-b923-c3fff52ee7f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:54.533113 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-fe38c2a5-3202-4c3c-b923-c3fff52ee7f7 None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:04:54.534434 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-fe38c2a5-3202-4c3c-b923-c3fff52ee7f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:04:54.542299 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d566303e-3c9b-40cf-9a06-5dbcbe240132 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:54.578142 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb90268-2197-45da-9a9e-4909959d61bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:54.578851 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb90268-2197-45da-9a9e-4909959d61bd None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:54.579132 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb90268-2197-45da-9a9e-4909959d61bd None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:54.579415 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb90268-2197-45da-9a9e-4909959d61bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:54.587865 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:54.588006 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:54.591000 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb90268-2197-45da-9a9e-4909959d61bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:54.592465 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb90268-2197-45da-9a9e-4909959d61bd None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:54.613796 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 292/598] 10.222.0.136 () {58 vars in 1028 bytes} [Thu Jul 14 17:04:54 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 17:04:54.613796 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe38c2a5-3202-4c3c-b923-c3fff52ee7f7 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:54.614142 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-bdb90268-2197-45da-9a9e-4909959d61bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:04:54.614142 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:04:54.614142 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:04:54.614142 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:04:54.614142 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:04:54.614142 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:04:54.614142 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:04:54.614142 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:04:54.614142 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:04:54.614142 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:04:54.614142 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:04:54.614142 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:04:54.614142 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 17:04:54.614142 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 17:04:54.614142 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 17:04:54.614969 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 17:04:54.614969 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:04:54.614969 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:04:54.614969 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:04:54.614969 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:04:54.614969 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:04:54.614969 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:04:54.614969 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:04:54.614969 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Jul 14 17:04:54.614969 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:04:54.614969 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:04:54.614969 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:04:54.614969 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:04:54.614969 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:04:54.614969 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:04:54.614969 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:04:54.614969 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:04:54.615887 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 17:04:54.615887 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 17:04:54.615887 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:04:54.615887 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Jul 14 17:04:54.615887 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 307/599] 10.222.0.136 () {56 vars in 1113 bytes} [Thu Jul 14 17:04:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:04:54.625720 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb90268-2197-45da-9a9e-4909959d61bd None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:54.731967 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe38c2a5-3202-4c3c-b923-c3fff52ee7f7 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:54.736634 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb90268-2197-45da-9a9e-4909959d61bd None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:54.773194 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fa2c1f-ae56-403e-a4d7-cdd28e7af266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:54.774033 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fa2c1f-ae56-403e-a4d7-cdd28e7af266 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:54.774327 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fa2c1f-ae56-403e-a4d7-cdd28e7af266 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:54.774611 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fa2c1f-ae56-403e-a4d7-cdd28e7af266 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:54.780353 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639ae615-f727-441a-9395-60fc85e0346f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:54.781014 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639ae615-f727-441a-9395-60fc85e0346f None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:54.781303 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639ae615-f727-441a-9395-60fc85e0346f None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:54.781601 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639ae615-f727-441a-9395-60fc85e0346f None admin] PATH_INFO: `/v3/domains` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:54.782762 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639ae615-f727-441a-9395-60fc85e0346f None admin] RBAC: Adding query filter params (name=Default) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:04:54.783074 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639ae615-f727-441a-9395-60fc85e0346f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:54.785447 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639ae615-f727-441a-9395-60fc85e0346f None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:54.786159 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fa2c1f-ae56-403e-a4d7-cdd28e7af266 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:54.787852 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fa2c1f-ae56-403e-a4d7-cdd28e7af266 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:54.802851 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 308/600] 10.222.0.136 () {56 vars in 1114 bytes} [Thu Jul 14 17:04:54 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 17:04:54.802851 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639ae615-f727-441a-9395-60fc85e0346f None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:54.807170 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-b7fa2c1f-ae56-403e-a4d7-cdd28e7af266 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:04:54.807170 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:04:54.807170 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:04:54.807170 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:04:54.807170 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:04:54.807170 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:04:54.807170 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:04:54.807170 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:04:54.807170 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:04:54.807170 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:04:54.807170 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:04:54.807170 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:04:54.807170 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 17:04:54.807170 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 17:04:54.807170 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 17:04:54.808060 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 17:04:54.808060 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:04:54.808060 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:04:54.808060 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:04:54.808060 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:04:54.808060 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:04:54.808060 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:04:54.808060 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:04:54.808060 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Jul 14 17:04:54.808060 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:04:54.808060 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:04:54.808060 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:04:54.808060 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:04:54.808060 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:04:54.808060 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:04:54.808060 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:04:54.808060 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:04:54.808932 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 17:04:54.808932 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 17:04:54.808932 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:04:54.808932 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Jul 14 17:04:54.813227 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 293/601] 10.222.0.136 () {56 vars in 1113 bytes} [Thu Jul 14 17:04:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:04:54.813960 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fa2c1f-ae56-403e-a4d7-cdd28e7af266 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:54.852984 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:54.862510 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:54.918293 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639ae615-f727-441a-9395-60fc85e0346f None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:54.937643 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fa2c1f-ae56-403e-a4d7-cdd28e7af266 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:54.956379 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf839372-c770-4256-9496-fa02288da456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:54.957933 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf839372-c770-4256-9496-fa02288da456 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:54.958231 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf839372-c770-4256-9496-fa02288da456 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:54.958509 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf839372-c770-4256-9496-fa02288da456 None admin] PATH_INFO: `/v3/roles/service` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:54.968853 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf839372-c770-4256-9496-fa02288da456 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 17:04:54.976897 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c1a14d-166f-495c-8d10-fb26c27fb30c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:54.977162 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-bf839372-c770-4256-9496-fa02288da456 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 17:04:54.977162 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:04:54.977162 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:04:54.977162 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:04:54.977162 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:04:54.977162 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:04:54.977162 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:04:54.977162 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:04:54.977162 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:04:54.977162 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:04:54.977162 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:04:54.977162 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:04:54.977162 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 17:04:54.977162 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 17:04:54.977162 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 17:04:54.977162 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 17:04:54.978281 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 17:04:54.978281 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 17:04:54.978281 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 17:04:54.978281 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 17:04:54.978281 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:04:54.978281 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:04:54.978281 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:04:54.978281 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:04:54.978281 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:04:54.978281 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:04:54.978281 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:04:54.978281 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Jul 14 17:04:54.978281 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:04:54.978281 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:04:54.978281 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:04:54.978281 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:04:54.979144 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:04:54.979144 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:04:54.979144 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:04:54.979144 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:04:54.979144 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 17:04:54.979144 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 17:04:54.979144 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 17:04:54.979144 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 17:04:54.979144 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 17:04:54.979144 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 17:04:54.979144 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 17:04:54.979144 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Jul 14 17:04:54.979786 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c1a14d-166f-495c-8d10-fb26c27fb30c None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:54.979786 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c1a14d-166f-495c-8d10-fb26c27fb30c None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:54.979786 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c1a14d-166f-495c-8d10-fb26c27fb30c None admin] PATH_INFO: `/v3/users/glance` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:54.980000 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 309/602] 10.222.0.136 () {56 vars in 1107 bytes} [Thu Jul 14 17:04:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:04:54.980000 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf839372-c770-4256-9496-fa02288da456 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:54.989526 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c1a14d-166f-495c-8d10-fb26c27fb30c None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:54.991013 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c1a14d-166f-495c-8d10-fb26c27fb30c None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:55.005805 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-f5c1a14d-166f-495c-8d10-fb26c27fb30c None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 14 17:04:55.005805 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:04:55.005805 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:04:55.005805 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:04:55.005805 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:04:55.005805 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:04:55.005805 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:04:55.005805 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:04:55.005805 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:04:55.005805 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:04:55.005805 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:04:55.005805 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:04:55.005805 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 17:04:55.005805 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 17:04:55.005805 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 17:04:55.005805 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 17:04:55.006763 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:04:55.006763 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:04:55.006763 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 17:04:55.006763 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 17:04:55.006763 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 17:04:55.006763 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 17:04:55.006763 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:04:55.006763 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:04:55.006763 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:04:55.006763 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:04:55.006763 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:04:55.006763 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Jul 14 17:04:55.006763 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:04:55.006763 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:04:55.006763 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:04:55.006763 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:04:55.006763 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:04:55.006763 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:04:55.007709 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:04:55.007709 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:04:55.007709 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 17:04:55.007709 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 17:04:55.007709 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 17:04:55.007709 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 17:04:55.007709 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 17:04:55.007709 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 17:04:55.007709 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 14 17:04:55.007709 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Jul 14 17:04:55.007709 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 294/603] 10.222.0.136 () {56 vars in 1104 bytes} [Thu Jul 14 17:04:54 2022] GET /identity/v3/users/glance => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:04:55.008536 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f5d2de-e640-45ef-bb26-0a50ff8c88c9 None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:55.008819 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f5d2de-e640-45ef-bb26-0a50ff8c88c9 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:55.009059 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f5d2de-e640-45ef-bb26-0a50ff8c88c9 None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:55.010407 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 295/604] 10.222.0.136 () {54 vars in 931 bytes} [Thu Jul 14 17:04:55 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:04:55.011096 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f5d2de-e640-45ef-bb26-0a50ff8c88c9 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:55.093651 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf839372-c770-4256-9496-fa02288da456 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:55.107682 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:55.119495 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:55.126976 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f5d2de-e640-45ef-bb26-0a50ff8c88c9 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:55.130921 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4cac88-d0fc-4ca0-9baa-5f1433d40693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:55.131590 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4cac88-d0fc-4ca0-9baa-5f1433d40693 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:55.131887 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4cac88-d0fc-4ca0-9baa-5f1433d40693 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:55.132169 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4cac88-d0fc-4ca0-9baa-5f1433d40693 None admin] PATH_INFO: `/v3/domains` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:55.132892 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4cac88-d0fc-4ca0-9baa-5f1433d40693 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:04:55.133206 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4cac88-d0fc-4ca0-9baa-5f1433d40693 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:55.134629 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4cac88-d0fc-4ca0-9baa-5f1433d40693 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:55.147739 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 310/605] 10.222.0.136 () {56 vars in 1114 bytes} [Thu Jul 14 17:04:54 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:04:55.148625 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4cac88-d0fc-4ca0-9baa-5f1433d40693 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:55.167046 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa2d8b1-d3e0-414e-a255-38f4e104a24b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:55.167724 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa2d8b1-d3e0-414e-a255-38f4e104a24b None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:55.168013 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa2d8b1-d3e0-414e-a255-38f4e104a24b None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:55.168298 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa2d8b1-d3e0-414e-a255-38f4e104a24b None admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:55.169050 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa2d8b1-d3e0-414e-a255-38f4e104a24b None admin] RBAC: Adding query filter params (name=service) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:04:55.169360 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa2d8b1-d3e0-414e-a255-38f4e104a24b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:55.170775 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa2d8b1-d3e0-414e-a255-38f4e104a24b None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:55.178975 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 296/606] 10.222.0.136 () {56 vars in 1108 bytes} [Thu Jul 14 17:04:55 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:04:55.180243 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a01afc-1b07-4541-ba87-7366bf9167b9 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:55.180544 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a01afc-1b07-4541-ba87-7366bf9167b9 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:55.180829 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a01afc-1b07-4541-ba87-7366bf9167b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:55.198067 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-d9a01afc-1b07-4541-ba87-7366bf9167b9 None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:04:55.199263 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-d9a01afc-1b07-4541-ba87-7366bf9167b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:04:55.274563 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4cac88-d0fc-4ca0-9baa-5f1433d40693 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:55.282378 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 297/607] 10.222.0.136 () {58 vars in 1028 bytes} [Thu Jul 14 17:04:55 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 17:04:55.283249 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a01afc-1b07-4541-ba87-7366bf9167b9 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:55.320045 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e528b2-422d-4e04-8986-5873aebe1c7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:55.320715 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e528b2-422d-4e04-8986-5873aebe1c7f None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:55.320998 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e528b2-422d-4e04-8986-5873aebe1c7f None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:55.321275 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e528b2-422d-4e04-8986-5873aebe1c7f None admin] PATH_INFO: `/v3/users` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:55.322148 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e528b2-422d-4e04-8986-5873aebe1c7f None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:04:55.322523 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e528b2-422d-4e04-8986-5873aebe1c7f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:55.323861 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e528b2-422d-4e04-8986-5873aebe1c7f None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:55.341636 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 311/608] 10.222.0.136 () {56 vars in 1142 bytes} [Thu Jul 14 17:04:55 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 374 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:04:55.342455 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e528b2-422d-4e04-8986-5873aebe1c7f None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:55.373494 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:55.394407 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:55.407639 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a01afc-1b07-4541-ba87-7366bf9167b9 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:55.443403 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d61836f-27e4-45be-a812-fa6cab6fa734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:55.444202 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d61836f-27e4-45be-a812-fa6cab6fa734 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:55.444354 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e528b2-422d-4e04-8986-5873aebe1c7f None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:55.444488 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d61836f-27e4-45be-a812-fa6cab6fa734 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:55.444763 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d61836f-27e4-45be-a812-fa6cab6fa734 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:55.452083 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d61836f-27e4-45be-a812-fa6cab6fa734 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:55.453525 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d61836f-27e4-45be-a812-fa6cab6fa734 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:55.467219 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-6d61836f-27e4-45be-a812-fa6cab6fa734 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 17:04:55.467219 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:04:55.467219 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:04:55.467219 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:04:55.467219 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:04:55.467219 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:04:55.467219 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:04:55.467219 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:04:55.467219 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:04:55.467219 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:04:55.467219 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:04:55.467219 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:04:55.467219 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 17:04:55.467219 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 17:04:55.467219 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 17:04:55.468174 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 17:04:55.468174 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:04:55.468174 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:04:55.468174 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:04:55.468174 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:04:55.468174 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:04:55.468174 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:04:55.468174 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:04:55.468174 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Jul 14 17:04:55.468174 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:04:55.468174 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:04:55.468174 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:04:55.468174 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:04:55.468174 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:04:55.468174 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:04:55.468174 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:04:55.468174 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:04:55.469060 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 17:04:55.469060 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 17:04:55.469060 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 17:04:55.469060 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 17:04:55.469060 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 17:04:55.469060 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 17:04:55.469060 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 17:04:55.469060 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Jul 14 17:04:55.469060 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 298/609] 10.222.0.136 () {56 vars in 1116 bytes} [Thu Jul 14 17:04:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:04:55.470033 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d61836f-27e4-45be-a812-fa6cab6fa734 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:55.483996 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04c9cba-8f12-4c90-8679-dca79b6f58f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:55.484788 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04c9cba-8f12-4c90-8679-dca79b6f58f2 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:55.485071 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04c9cba-8f12-4c90-8679-dca79b6f58f2 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:55.485349 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04c9cba-8f12-4c90-8679-dca79b6f58f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:55.496027 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04c9cba-8f12-4c90-8679-dca79b6f58f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:55.497449 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04c9cba-8f12-4c90-8679-dca79b6f58f2 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:55.514865 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-e04c9cba-8f12-4c90-8679-dca79b6f58f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:04:55.514865 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:04:55.514865 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:04:55.514865 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:04:55.514865 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:04:55.514865 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:04:55.514865 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:04:55.514865 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:04:55.514865 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:04:55.514865 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:04:55.514865 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:04:55.514865 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:04:55.514865 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 17:04:55.514865 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 17:04:55.514865 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 17:04:55.515879 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 17:04:55.515879 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:04:55.515879 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:04:55.515879 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:04:55.515879 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:04:55.515879 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:04:55.515879 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:04:55.515879 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:04:55.515879 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Jul 14 17:04:55.515879 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:04:55.515879 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:04:55.515879 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:04:55.515879 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:04:55.515879 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:04:55.515879 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:04:55.515879 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:04:55.515879 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:04:55.516777 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 17:04:55.516777 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 17:04:55.516777 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:04:55.516777 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Jul 14 17:04:55.516777 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 312/610] 10.222.0.136 () {56 vars in 1113 bytes} [Thu Jul 14 17:04:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:04:55.516777 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04c9cba-8f12-4c90-8679-dca79b6f58f2 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:55.572007 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d61836f-27e4-45be-a812-fa6cab6fa734 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:55.600744 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:55.607324 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8e4809-d073-49f1-b535-1362ddfdf16e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:55.608121 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8e4809-d073-49f1-b535-1362ddfdf16e None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:55.608413 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8e4809-d073-49f1-b535-1362ddfdf16e None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:55.608686 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8e4809-d073-49f1-b535-1362ddfdf16e None admin] PATH_INFO: `/v3/roles/service` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:55.619534 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8e4809-d073-49f1-b535-1362ddfdf16e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 17:04:55.619989 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04c9cba-8f12-4c90-8679-dca79b6f58f2 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:55.627602 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-ca8e4809-d073-49f1-b535-1362ddfdf16e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 17:04:55.627602 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:04:55.627602 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:04:55.627602 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:04:55.627602 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:04:55.627602 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:04:55.627602 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:04:55.627602 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:04:55.627602 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:04:55.627602 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:04:55.627602 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:04:55.627602 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:04:55.627602 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 17:04:55.627602 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 17:04:55.627602 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 17:04:55.627602 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 17:04:55.629330 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 17:04:55.629330 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 17:04:55.629330 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 17:04:55.629330 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 17:04:55.629330 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:04:55.629330 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:04:55.629330 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:04:55.629330 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:04:55.629330 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:04:55.629330 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:04:55.629330 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:04:55.629330 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Jul 14 17:04:55.629330 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:04:55.629330 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:04:55.629330 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:04:55.629330 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:04:55.630761 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:04:55.630761 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:04:55.630761 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:04:55.630761 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:04:55.630761 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 17:04:55.630761 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 17:04:55.630761 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 17:04:55.630761 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 17:04:55.630761 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 17:04:55.630761 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 17:04:55.630761 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 17:04:55.630761 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Jul 14 17:04:55.630761 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 299/611] 10.222.0.136 () {56 vars in 1107 bytes} [Thu Jul 14 17:04:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:04:55.630761 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8e4809-d073-49f1-b535-1362ddfdf16e None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:55.645475 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:55.660850 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07907d39-9015-4b6a-b61f-543a8a2baa7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:55.661492 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07907d39-9015-4b6a-b61f-543a8a2baa7c None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:55.661807 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07907d39-9015-4b6a-b61f-543a8a2baa7c None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:55.662087 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07907d39-9015-4b6a-b61f-543a8a2baa7c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:55.730520 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07907d39-9015-4b6a-b61f-543a8a2baa7c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:55.731983 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07907d39-9015-4b6a-b61f-543a8a2baa7c None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:55.733583 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8e4809-d073-49f1-b535-1362ddfdf16e None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:55.767379 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c95872-2298-4b56-90ac-8fe17ef727c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:55.768000 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c95872-2298-4b56-90ac-8fe17ef727c2 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:55.768295 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c95872-2298-4b56-90ac-8fe17ef727c2 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:55.768561 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c95872-2298-4b56-90ac-8fe17ef727c2 None admin] PATH_INFO: `/v3/projects` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:55.769367 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c95872-2298-4b56-90ac-8fe17ef727c2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:04:55.769775 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c95872-2298-4b56-90ac-8fe17ef727c2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:55.771360 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c95872-2298-4b56-90ac-8fe17ef727c2 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:55.783905 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 300/612] 10.222.0.136 () {56 vars in 1153 bytes} [Thu Jul 14 17:04:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:04:55.784719 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c95872-2298-4b56-90ac-8fe17ef727c2 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:55.816046 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:55.835907 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 313/613] 10.222.0.136 () {58 vars in 1287 bytes} [Thu Jul 14 17:04:55 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 17:04:55.836741 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07907d39-9015-4b6a-b61f-543a8a2baa7c None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:55.854881 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:55.888995 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c95872-2298-4b56-90ac-8fe17ef727c2 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:55.923512 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d09b3b0-01e4-4f8a-9e42-bf8f66b9a5cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:55.924181 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d09b3b0-01e4-4f8a-9e42-bf8f66b9a5cb None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:55.924468 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d09b3b0-01e4-4f8a-9e42-bf8f66b9a5cb None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:55.924744 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d09b3b0-01e4-4f8a-9e42-bf8f66b9a5cb None admin] PATH_INFO: `/v3/domains` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:55.925455 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d09b3b0-01e4-4f8a-9e42-bf8f66b9a5cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:04:55.925837 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d09b3b0-01e4-4f8a-9e42-bf8f66b9a5cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:55.927309 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d09b3b0-01e4-4f8a-9e42-bf8f66b9a5cb None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:55.936293 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07907d39-9015-4b6a-b61f-543a8a2baa7c None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:55.938297 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 301/614] 10.222.0.136 () {56 vars in 1114 bytes} [Thu Jul 14 17:04:55 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:04:55.939080 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d09b3b0-01e4-4f8a-9e42-bf8f66b9a5cb None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:55.971711 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997cc0af-64e3-4938-8a38-e7ce617f8884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:55.972404 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997cc0af-64e3-4938-8a38-e7ce617f8884 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:55.973216 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997cc0af-64e3-4938-8a38-e7ce617f8884 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:55.973498 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997cc0af-64e3-4938-8a38-e7ce617f8884 None admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:55.974286 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997cc0af-64e3-4938-8a38-e7ce617f8884 None admin] RBAC: Adding query filter params (name=service) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:04:55.974593 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997cc0af-64e3-4938-8a38-e7ce617f8884 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:55.975955 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997cc0af-64e3-4938-8a38-e7ce617f8884 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:55.984672 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 314/615] 10.222.0.136 () {56 vars in 1108 bytes} [Thu Jul 14 17:04:55 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:04:55.985450 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997cc0af-64e3-4938-8a38-e7ce617f8884 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:56.036164 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:56.043881 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d09b3b0-01e4-4f8a-9e42-bf8f66b9a5cb None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:56.071315 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:56.079186 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c27cd80-79c8-4b18-8e69-2a408b3fa93b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:56.079994 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c27cd80-79c8-4b18-8e69-2a408b3fa93b None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:56.080963 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c27cd80-79c8-4b18-8e69-2a408b3fa93b None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:56.080963 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c27cd80-79c8-4b18-8e69-2a408b3fa93b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:56.081814 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c27cd80-79c8-4b18-8e69-2a408b3fa93b None admin] RBAC: Adding query filter params (role.id=5e0ec7345cc84921907ca95b801a656b, scope.project.id=d57eaa6dbca24cbb99dce1fe3437ecae, user.id=bc2b7d015c2046ddacac6e682f22d0f5) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:04:56.082160 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c27cd80-79c8-4b18-8e69-2a408b3fa93b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:56.083599 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c27cd80-79c8-4b18-8e69-2a408b3fa93b None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:56.105664 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 302/616] 10.222.0.136 () {56 vars in 1379 bytes} [Thu Jul 14 17:04:55 2022] GET /identity/v3/role_assignments?user.id=bc2b7d015c2046ddacac6e682f22d0f5&scope.project.id=d57eaa6dbca24cbb99dce1fe3437ecae&role.id=5e0ec7345cc84921907ca95b801a656b => generated 610 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:04:56.105664 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c27cd80-79c8-4b18-8e69-2a408b3fa93b None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:56.106007 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997cc0af-64e3-4938-8a38-e7ce617f8884 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:56.143349 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9195685-65c5-4aeb-86b9-fe42e53ccf62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:56.144036 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9195685-65c5-4aeb-86b9-fe42e53ccf62 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:56.144406 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9195685-65c5-4aeb-86b9-fe42e53ccf62 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:56.144971 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9195685-65c5-4aeb-86b9-fe42e53ccf62 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:56.158007 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9195685-65c5-4aeb-86b9-fe42e53ccf62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:56.159528 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9195685-65c5-4aeb-86b9-fe42e53ccf62 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:56.181535 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-a9195685-65c5-4aeb-86b9-fe42e53ccf62 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:04:56.181535 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:04:56.181535 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:04:56.181535 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:04:56.181535 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:04:56.181535 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:04:56.181535 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:04:56.181535 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:04:56.181535 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:04:56.181535 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:04:56.181535 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:04:56.181535 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:04:56.181535 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 17:04:56.181535 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 17:04:56.181535 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 17:04:56.182532 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 17:04:56.182532 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:04:56.182532 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:04:56.182532 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:04:56.182532 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:04:56.182532 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:04:56.182532 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:04:56.182532 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:04:56.182532 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Jul 14 17:04:56.182532 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:04:56.182532 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:04:56.182532 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:04:56.182532 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:04:56.182532 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:04:56.182532 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:04:56.182532 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:04:56.182532 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:04:56.183473 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 17:04:56.183473 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 17:04:56.183473 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:04:56.183473 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Jul 14 17:04:56.183473 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 315/617] 10.222.0.136 () {56 vars in 1113 bytes} [Thu Jul 14 17:04:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:04:56.183768 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9195685-65c5-4aeb-86b9-fe42e53ccf62 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:56.242440 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c27cd80-79c8-4b18-8e69-2a408b3fa93b None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:56.283871 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a46f27-64f4-4242-956c-8e983e68014e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:56.284688 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a46f27-64f4-4242-956c-8e983e68014e None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:56.285594 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a46f27-64f4-4242-956c-8e983e68014e None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:56.286369 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a46f27-64f4-4242-956c-8e983e68014e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:56.297343 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a46f27-64f4-4242-956c-8e983e68014e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:56.298857 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a46f27-64f4-4242-956c-8e983e68014e None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:56.317854 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-a2a46f27-64f4-4242-956c-8e983e68014e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 14 17:04:56.317854 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:04:56.317854 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:04:56.317854 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:04:56.317854 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:04:56.317854 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:04:56.317854 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:04:56.317854 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:04:56.317854 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:04:56.317854 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:04:56.317854 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:04:56.317854 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:04:56.317854 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 17:04:56.317854 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 17:04:56.317854 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 17:04:56.317854 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 17:04:56.319037 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:04:56.319037 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:04:56.319037 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 17:04:56.319037 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 17:04:56.319037 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 17:04:56.319037 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 17:04:56.319037 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:04:56.319037 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:04:56.319037 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:04:56.319037 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:04:56.319037 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:04:56.319037 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Jul 14 17:04:56.319037 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:04:56.319037 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:04:56.319037 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:04:56.319037 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:04:56.319037 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:04:56.319037 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:04:56.320047 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:04:56.320047 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:04:56.320047 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 17:04:56.320047 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 17:04:56.320047 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 17:04:56.320047 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 17:04:56.320047 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 17:04:56.320047 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 17:04:56.320047 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 14 17:04:56.320047 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Jul 14 17:04:56.320047 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 303/618] 10.222.0.136 () {56 vars in 1104 bytes} [Thu Jul 14 17:04:56 2022] GET /identity/v3/users/cinder => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:04:56.320685 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a46f27-64f4-4242-956c-8e983e68014e None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:56.326666 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:56.334682 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9195685-65c5-4aeb-86b9-fe42e53ccf62 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:56.378562 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505677c8-f77e-4306-b16a-6fc6c4995146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:56.379419 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505677c8-f77e-4306-b16a-6fc6c4995146 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:56.379700 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505677c8-f77e-4306-b16a-6fc6c4995146 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:56.379980 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505677c8-f77e-4306-b16a-6fc6c4995146 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:56.392076 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505677c8-f77e-4306-b16a-6fc6c4995146 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:56.393474 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:56.393857 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505677c8-f77e-4306-b16a-6fc6c4995146 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:56.420188 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-505677c8-f77e-4306-b16a-6fc6c4995146 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:04:56.420188 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:04:56.420188 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:04:56.420188 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:04:56.420188 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:04:56.420188 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:04:56.420188 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:04:56.420188 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:04:56.420188 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:04:56.420188 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:04:56.420188 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:04:56.420188 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:04:56.420188 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 17:04:56.420188 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 17:04:56.420188 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 17:04:56.421308 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 17:04:56.421308 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:04:56.421308 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:04:56.421308 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:04:56.421308 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:04:56.421308 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:04:56.421308 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:04:56.421308 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:04:56.421308 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Jul 14 17:04:56.421308 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:04:56.421308 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:04:56.421308 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:04:56.421308 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:04:56.421308 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:04:56.421308 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:04:56.421308 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:04:56.421308 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:04:56.422292 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 17:04:56.422292 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 17:04:56.422292 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:04:56.422292 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Jul 14 17:04:56.422292 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 316/619] 10.222.0.136 () {56 vars in 1113 bytes} [Thu Jul 14 17:04:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:04:56.422659 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505677c8-f77e-4306-b16a-6fc6c4995146 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:56.457361 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a46f27-64f4-4242-956c-8e983e68014e None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:56.498319 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327ce95a-4818-4cb4-b9cc-4d66691036e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:56.499011 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327ce95a-4818-4cb4-b9cc-4d66691036e2 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:56.499319 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327ce95a-4818-4cb4-b9cc-4d66691036e2 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:56.499574 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327ce95a-4818-4cb4-b9cc-4d66691036e2 None admin] PATH_INFO: `/v3/domains` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:56.500300 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327ce95a-4818-4cb4-b9cc-4d66691036e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:04:56.500612 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327ce95a-4818-4cb4-b9cc-4d66691036e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:56.502036 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327ce95a-4818-4cb4-b9cc-4d66691036e2 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:56.519103 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 304/620] 10.222.0.136 () {56 vars in 1114 bytes} [Thu Jul 14 17:04:56 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:04:56.519103 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327ce95a-4818-4cb4-b9cc-4d66691036e2 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:56.558584 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505677c8-f77e-4306-b16a-6fc6c4995146 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:56.599757 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf324e7-212a-4333-aeef-f1d6c4fdb04b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:56.600439 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf324e7-212a-4333-aeef-f1d6c4fdb04b None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:56.600726 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf324e7-212a-4333-aeef-f1d6c4fdb04b None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:56.601007 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf324e7-212a-4333-aeef-f1d6c4fdb04b None admin] PATH_INFO: `/v3/users` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:56.601892 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf324e7-212a-4333-aeef-f1d6c4fdb04b None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:04:56.602207 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf324e7-212a-4333-aeef-f1d6c4fdb04b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:56.603672 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf324e7-212a-4333-aeef-f1d6c4fdb04b None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:56.624474 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 317/621] 10.222.0.136 () {56 vars in 1142 bytes} [Thu Jul 14 17:04:56 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 374 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:04:56.625330 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf324e7-212a-4333-aeef-f1d6c4fdb04b None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:56.637035 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:56.652805 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327ce95a-4818-4cb4-b9cc-4d66691036e2 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:56.668791 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:56.693023 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87597a5d-551c-45a4-b275-da09900ae8d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:56.693908 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87597a5d-551c-45a4-b275-da09900ae8d0 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:56.694297 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87597a5d-551c-45a4-b275-da09900ae8d0 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:56.694679 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87597a5d-551c-45a4-b275-da09900ae8d0 None admin] PATH_INFO: `/v3/domains` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:56.695530 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87597a5d-551c-45a4-b275-da09900ae8d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:04:56.695979 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87597a5d-551c-45a4-b275-da09900ae8d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:56.697463 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87597a5d-551c-45a4-b275-da09900ae8d0 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:56.714965 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 305/622] 10.222.0.136 () {56 vars in 1114 bytes} [Thu Jul 14 17:04:56 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:04:56.715846 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87597a5d-551c-45a4-b275-da09900ae8d0 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:56.755568 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf324e7-212a-4333-aeef-f1d6c4fdb04b None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:56.801595 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3febf99d-bafb-459b-89c7-25873f010ea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:56.802767 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3febf99d-bafb-459b-89c7-25873f010ea1 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:56.803263 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3febf99d-bafb-459b-89c7-25873f010ea1 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:56.803771 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3febf99d-bafb-459b-89c7-25873f010ea1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:56.812961 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3febf99d-bafb-459b-89c7-25873f010ea1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:56.814947 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3febf99d-bafb-459b-89c7-25873f010ea1 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:56.830823 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87597a5d-551c-45a4-b275-da09900ae8d0 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:56.831577 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-3febf99d-bafb-459b-89c7-25873f010ea1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 17:04:56.831577 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:04:56.831577 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:04:56.831577 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:04:56.831577 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:04:56.831577 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:04:56.831577 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:04:56.831577 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:04:56.831577 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:04:56.831577 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:04:56.831577 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:04:56.831577 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:04:56.831577 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 17:04:56.831577 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 17:04:56.831577 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 17:04:56.832664 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 17:04:56.832664 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:04:56.832664 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:04:56.832664 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:04:56.832664 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:04:56.832664 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:04:56.832664 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:04:56.832664 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:04:56.832664 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Jul 14 17:04:56.832664 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:04:56.832664 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:04:56.832664 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:04:56.832664 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:04:56.832664 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:04:56.832664 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:04:56.832664 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:04:56.832664 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:04:56.833795 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 17:04:56.833795 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 17:04:56.833795 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 17:04:56.833795 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 17:04:56.833795 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 17:04:56.833795 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 17:04:56.833795 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 17:04:56.833795 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Jul 14 17:04:56.840454 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 318/623] 10.222.0.136 () {56 vars in 1116 bytes} [Thu Jul 14 17:04:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:04:56.840454 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3febf99d-bafb-459b-89c7-25873f010ea1 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:56.876504 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3098b84d-e200-46e8-a575-58b5fede9e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:56.877262 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3098b84d-e200-46e8-a575-58b5fede9e16 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:56.877652 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3098b84d-e200-46e8-a575-58b5fede9e16 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:56.878005 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3098b84d-e200-46e8-a575-58b5fede9e16 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:56.909112 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:56.925499 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:56.958248 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3febf99d-bafb-459b-89c7-25873f010ea1 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:56.963585 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3098b84d-e200-46e8-a575-58b5fede9e16 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:56.965050 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3098b84d-e200-46e8-a575-58b5fede9e16 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:56.995384 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c09972-3176-4ddf-983b-579c0b545903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:56.996179 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c09972-3176-4ddf-983b-579c0b545903 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:56.996471 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c09972-3176-4ddf-983b-579c0b545903 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:56.996748 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c09972-3176-4ddf-983b-579c0b545903 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:57.005140 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c09972-3176-4ddf-983b-579c0b545903 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:57.006626 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c09972-3176-4ddf-983b-579c0b545903 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:57.021999 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-18c09972-3176-4ddf-983b-579c0b545903 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 14 17:04:57.021999 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:04:57.021999 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:04:57.021999 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:04:57.021999 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:04:57.021999 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:04:57.021999 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:04:57.021999 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:04:57.021999 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:04:57.021999 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:04:57.021999 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:04:57.021999 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:04:57.021999 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 17:04:57.021999 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 17:04:57.021999 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 17:04:57.021999 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 17:04:57.022986 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:04:57.022986 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:04:57.022986 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 17:04:57.022986 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 17:04:57.022986 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 17:04:57.022986 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 17:04:57.022986 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:04:57.022986 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:04:57.022986 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:04:57.022986 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:04:57.022986 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:04:57.022986 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Jul 14 17:04:57.022986 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:04:57.022986 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:04:57.022986 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:04:57.022986 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:04:57.022986 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:04:57.022986 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:04:57.023952 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:04:57.023952 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:04:57.023952 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 17:04:57.023952 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 17:04:57.023952 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 17:04:57.023952 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 17:04:57.023952 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 17:04:57.023952 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 17:04:57.023952 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 14 17:04:57.023952 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Jul 14 17:04:57.023952 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 319/624] 10.222.0.136 () {56 vars in 1107 bytes} [Thu Jul 14 17:04:56 2022] GET /identity/v3/users/neutron => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:04:57.024562 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c09972-3176-4ddf-983b-579c0b545903 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:57.089609 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 306/625] 10.222.0.136 () {58 vars in 1287 bytes} [Thu Jul 14 17:04:56 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 17:04:57.090504 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3098b84d-e200-46e8-a575-58b5fede9e16 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:57.147689 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c09972-3176-4ddf-983b-579c0b545903 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:57.168933 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:57.178181 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:57.186859 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5383a504-0e35-4382-8cba-8eabe28ea674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:57.187519 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5383a504-0e35-4382-8cba-8eabe28ea674 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:57.187808 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5383a504-0e35-4382-8cba-8eabe28ea674 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:57.188191 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5383a504-0e35-4382-8cba-8eabe28ea674 None admin] PATH_INFO: `/v3/projects` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:57.188976 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5383a504-0e35-4382-8cba-8eabe28ea674 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:04:57.189612 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5383a504-0e35-4382-8cba-8eabe28ea674 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:57.190857 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5383a504-0e35-4382-8cba-8eabe28ea674 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:57.205728 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3098b84d-e200-46e8-a575-58b5fede9e16 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:57.211990 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 320/626] 10.222.0.136 () {56 vars in 1153 bytes} [Thu Jul 14 17:04:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:04:57.212853 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5383a504-0e35-4382-8cba-8eabe28ea674 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:57.249607 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68188231-6182-470a-8064-68312b086ac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:57.250300 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68188231-6182-470a-8064-68312b086ac9 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:57.250592 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68188231-6182-470a-8064-68312b086ac9 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:57.250871 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68188231-6182-470a-8064-68312b086ac9 None admin] PATH_INFO: `/v3/users` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:57.251708 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68188231-6182-470a-8064-68312b086ac9 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:04:57.252026 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68188231-6182-470a-8064-68312b086ac9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:57.253469 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68188231-6182-470a-8064-68312b086ac9 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:57.275209 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 307/627] 10.222.0.136 () {56 vars in 1144 bytes} [Thu Jul 14 17:04:57 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 376 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:04:57.276223 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68188231-6182-470a-8064-68312b086ac9 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:57.335059 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5383a504-0e35-4382-8cba-8eabe28ea674 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:57.374491 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e130fbd-4225-4db2-9d94-6ab0f101cd4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:57.375283 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e130fbd-4225-4db2-9d94-6ab0f101cd4d None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:57.375567 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e130fbd-4225-4db2-9d94-6ab0f101cd4d None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:57.375842 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e130fbd-4225-4db2-9d94-6ab0f101cd4d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:57.387332 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e130fbd-4225-4db2-9d94-6ab0f101cd4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:57.388845 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e130fbd-4225-4db2-9d94-6ab0f101cd4d None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:57.391333 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68188231-6182-470a-8064-68312b086ac9 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:57.406742 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-4e130fbd-4225-4db2-9d94-6ab0f101cd4d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:04:57.406742 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:04:57.406742 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:04:57.406742 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:04:57.406742 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:04:57.406742 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:04:57.406742 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:04:57.406742 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:04:57.406742 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:04:57.406742 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:04:57.406742 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:04:57.406742 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:04:57.406742 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 17:04:57.406742 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 17:04:57.406742 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 17:04:57.407833 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 17:04:57.407833 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:04:57.407833 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:04:57.407833 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:04:57.407833 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:04:57.407833 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:04:57.407833 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:04:57.407833 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:04:57.407833 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Jul 14 17:04:57.407833 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:04:57.407833 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:04:57.407833 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:04:57.407833 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:04:57.407833 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:04:57.407833 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:04:57.407833 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:04:57.407833 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:04:57.408737 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 17:04:57.408737 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 17:04:57.408737 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:04:57.408737 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Jul 14 17:04:57.408737 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 321/628] 10.222.0.136 () {56 vars in 1113 bytes} [Thu Jul 14 17:04:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:04:57.409033 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e130fbd-4225-4db2-9d94-6ab0f101cd4d None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:57.424489 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:57.432127 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452ff2ab-cbc0-4016-a7c0-56096c17d0e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:57.432797 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452ff2ab-cbc0-4016-a7c0-56096c17d0e6 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:57.433086 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452ff2ab-cbc0-4016-a7c0-56096c17d0e6 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:57.433366 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452ff2ab-cbc0-4016-a7c0-56096c17d0e6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:57.434254 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452ff2ab-cbc0-4016-a7c0-56096c17d0e6 None admin] RBAC: Adding query filter params (role.id=5e0ec7345cc84921907ca95b801a656b, scope.project.id=d57eaa6dbca24cbb99dce1fe3437ecae, user.id=c2c3d46d376c460a99426a5dc7c66115) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:04:57.434574 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452ff2ab-cbc0-4016-a7c0-56096c17d0e6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:57.436019 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452ff2ab-cbc0-4016-a7c0-56096c17d0e6 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:57.443688 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 308/629] 10.222.0.136 () {56 vars in 1379 bytes} [Thu Jul 14 17:04:57 2022] GET /identity/v3/role_assignments?user.id=c2c3d46d376c460a99426a5dc7c66115&scope.project.id=d57eaa6dbca24cbb99dce1fe3437ecae&role.id=5e0ec7345cc84921907ca95b801a656b => generated 610 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:04:57.444476 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452ff2ab-cbc0-4016-a7c0-56096c17d0e6 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:57.469939 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:57.531979 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e130fbd-4225-4db2-9d94-6ab0f101cd4d None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:57.570207 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c099b8e-be73-431b-9718-1303d6f1fbd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:57.571262 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c099b8e-be73-431b-9718-1303d6f1fbd5 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:57.571798 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c099b8e-be73-431b-9718-1303d6f1fbd5 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:57.572277 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c099b8e-be73-431b-9718-1303d6f1fbd5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:57.594832 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452ff2ab-cbc0-4016-a7c0-56096c17d0e6 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:57.647336 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20fae1f-770c-4572-8785-dc54e678738e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:57.648022 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20fae1f-770c-4572-8785-dc54e678738e None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:57.648302 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20fae1f-770c-4572-8785-dc54e678738e None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:57.648586 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20fae1f-770c-4572-8785-dc54e678738e None admin] PATH_INFO: `/v3/domains` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:57.649316 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20fae1f-770c-4572-8785-dc54e678738e None admin] RBAC: Adding query filter params (name=Default) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:04:57.649669 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20fae1f-770c-4572-8785-dc54e678738e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:57.651053 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20fae1f-770c-4572-8785-dc54e678738e None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:57.655896 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c099b8e-be73-431b-9718-1303d6f1fbd5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:57.657334 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c099b8e-be73-431b-9718-1303d6f1fbd5 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:57.667097 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 309/630] 10.222.0.136 () {56 vars in 1114 bytes} [Thu Jul 14 17:04:57 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:04:57.674407 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20fae1f-770c-4572-8785-dc54e678738e None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:57.718845 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:57.744022 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:57.798562 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20fae1f-770c-4572-8785-dc54e678738e None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:57.805126 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 322/631] 10.222.0.136 () {58 vars in 1287 bytes} [Thu Jul 14 17:04:57 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 17:04:57.812539 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c099b8e-be73-431b-9718-1303d6f1fbd5 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:57.844011 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a587e6a3-9d42-4dba-8b41-0967b9329832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:57.844827 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a587e6a3-9d42-4dba-8b41-0967b9329832 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:57.845113 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a587e6a3-9d42-4dba-8b41-0967b9329832 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:57.845393 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a587e6a3-9d42-4dba-8b41-0967b9329832 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:57.853308 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a587e6a3-9d42-4dba-8b41-0967b9329832 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:57.854875 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a587e6a3-9d42-4dba-8b41-0967b9329832 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:57.869745 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-a587e6a3-9d42-4dba-8b41-0967b9329832 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 17:04:57.869745 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:04:57.869745 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:04:57.869745 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:04:57.869745 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:04:57.869745 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:04:57.869745 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:04:57.869745 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:04:57.869745 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:04:57.869745 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:04:57.869745 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:04:57.869745 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:04:57.869745 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 17:04:57.869745 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 17:04:57.869745 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 17:04:57.870692 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 17:04:57.870692 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:04:57.870692 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:04:57.870692 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:04:57.870692 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:04:57.870692 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:04:57.870692 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:04:57.870692 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:04:57.870692 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Jul 14 17:04:57.870692 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:04:57.870692 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:04:57.870692 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:04:57.870692 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:04:57.870692 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:04:57.870692 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:04:57.870692 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:04:57.870692 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:04:57.871570 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 17:04:57.871570 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 17:04:57.871570 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 17:04:57.871570 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 17:04:57.871570 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 17:04:57.871570 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 17:04:57.871570 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 17:04:57.871570 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Jul 14 17:04:57.871570 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 310/632] 10.222.0.136 () {56 vars in 1116 bytes} [Thu Jul 14 17:04:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 17:04:57.876602 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a587e6a3-9d42-4dba-8b41-0967b9329832 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:57.947952 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c099b8e-be73-431b-9718-1303d6f1fbd5 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:57.990890 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a587e6a3-9d42-4dba-8b41-0967b9329832 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:57.999080 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afd26a8-d5a9-42d6-a48f-07d4303985cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:58.000867 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afd26a8-d5a9-42d6-a48f-07d4303985cb None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:58.001336 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afd26a8-d5a9-42d6-a48f-07d4303985cb None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:58.001832 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afd26a8-d5a9-42d6-a48f-07d4303985cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:58.006442 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:58.012814 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:58.021965 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afd26a8-d5a9-42d6-a48f-07d4303985cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:58.024460 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afd26a8-d5a9-42d6-a48f-07d4303985cb None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:58.031401 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db32d93-a012-42e2-8121-67dcc6320d1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:58.032191 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db32d93-a012-42e2-8121-67dcc6320d1c None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:58.032577 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db32d93-a012-42e2-8121-67dcc6320d1c None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:58.032955 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db32d93-a012-42e2-8121-67dcc6320d1c None admin] PATH_INFO: `/v3/projects` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:58.033982 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db32d93-a012-42e2-8121-67dcc6320d1c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:04:58.034416 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db32d93-a012-42e2-8121-67dcc6320d1c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:58.036218 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db32d93-a012-42e2-8121-67dcc6320d1c None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:58.047487 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-3afd26a8-d5a9-42d6-a48f-07d4303985cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:04:58.047487 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:04:58.047487 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:04:58.047487 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:04:58.047487 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:04:58.047487 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:04:58.047487 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:04:58.047487 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:04:58.047487 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:04:58.047487 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:04:58.047487 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:04:58.047487 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:04:58.047487 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 17:04:58.047487 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 17:04:58.047487 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 17:04:58.048549 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 17:04:58.048549 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:04:58.048549 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:04:58.048549 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:04:58.048549 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:04:58.048549 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:04:58.048549 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:04:58.048549 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:04:58.048549 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Jul 14 17:04:58.048549 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:04:58.048549 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:04:58.048549 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:04:58.048549 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:04:58.048549 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:04:58.048549 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:04:58.048549 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:04:58.048549 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:04:58.049653 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 17:04:58.049653 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 17:04:58.049653 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:04:58.049653 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Jul 14 17:04:58.057468 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 323/634] 10.222.0.136 () {56 vars in 1113 bytes} [Thu Jul 14 17:04:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:04:58.057706 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 311/634] 10.222.0.136 () {56 vars in 1153 bytes} [Thu Jul 14 17:04:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 17:04:58.058679 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afd26a8-d5a9-42d6-a48f-07d4303985cb None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:58.058796 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db32d93-a012-42e2-8121-67dcc6320d1c None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:58.173675 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db32d93-a012-42e2-8121-67dcc6320d1c None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:58.200220 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afd26a8-d5a9-42d6-a48f-07d4303985cb None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:58.213964 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b3e541-ce24-4400-8b9d-b9b8907f94e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:58.214883 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b3e541-ce24-4400-8b9d-b9b8907f94e4 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:58.215303 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b3e541-ce24-4400-8b9d-b9b8907f94e4 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:58.215787 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b3e541-ce24-4400-8b9d-b9b8907f94e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:58.216825 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b3e541-ce24-4400-8b9d-b9b8907f94e4 None admin] RBAC: Adding query filter params (role.id=5e0ec7345cc84921907ca95b801a656b, scope.project.id=d57eaa6dbca24cbb99dce1fe3437ecae, user.id=5fc301707c5d4f759b61266af952e625) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:04:58.217348 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b3e541-ce24-4400-8b9d-b9b8907f94e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:58.218990 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b3e541-ce24-4400-8b9d-b9b8907f94e4 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:58.227864 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 312/635] 10.222.0.136 () {56 vars in 1379 bytes} [Thu Jul 14 17:04:58 2022] GET /identity/v3/role_assignments?user.id=5fc301707c5d4f759b61266af952e625&scope.project.id=d57eaa6dbca24cbb99dce1fe3437ecae&role.id=5e0ec7345cc84921907ca95b801a656b => generated 610 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:04:58.249662 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fd3fea-1857-4229-a574-5339423bbade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:58.250270 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fd3fea-1857-4229-a574-5339423bbade None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:58.250556 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fd3fea-1857-4229-a574-5339423bbade None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:58.250836 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fd3fea-1857-4229-a574-5339423bbade None admin] PATH_INFO: `/v3/domains` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:58.251574 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fd3fea-1857-4229-a574-5339423bbade None admin] RBAC: Adding query filter params (name=Default) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:04:58.251898 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fd3fea-1857-4229-a574-5339423bbade None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:58.253298 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fd3fea-1857-4229-a574-5339423bbade None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:58.268381 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 324/636] 10.222.0.136 () {56 vars in 1114 bytes} [Thu Jul 14 17:04:58 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:04:58.274079 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b3e541-ce24-4400-8b9d-b9b8907f94e4 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:58.322476 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:58.397456 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b3e541-ce24-4400-8b9d-b9b8907f94e4 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:58.434595 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c430064c-cc65-4b72-981f-98652a12c33a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:58.435407 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c430064c-cc65-4b72-981f-98652a12c33a None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:58.435702 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c430064c-cc65-4b72-981f-98652a12c33a None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:58.435978 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c430064c-cc65-4b72-981f-98652a12c33a None admin] PATH_INFO: `/v3/projects/service` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:58.443693 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c430064c-cc65-4b72-981f-98652a12c33a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:58.445352 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c430064c-cc65-4b72-981f-98652a12c33a None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:58.459927 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-c430064c-cc65-4b72-981f-98652a12c33a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 17:04:58.459927 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:04:58.459927 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:04:58.459927 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:04:58.459927 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:04:58.459927 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:04:58.459927 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:04:58.459927 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:04:58.459927 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:04:58.459927 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:04:58.459927 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:04:58.459927 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:04:58.459927 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 17:04:58.459927 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 17:04:58.459927 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 17:04:58.460824 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 17:04:58.460824 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:04:58.460824 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:04:58.460824 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:04:58.460824 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:04:58.460824 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:04:58.460824 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:04:58.460824 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:04:58.460824 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Jul 14 17:04:58.460824 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:04:58.460824 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:04:58.460824 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:04:58.460824 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:04:58.460824 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:04:58.460824 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:04:58.460824 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:04:58.460824 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:04:58.461780 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 17:04:58.461780 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 17:04:58.461780 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 17:04:58.461780 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 17:04:58.461780 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 17:04:58.461780 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 17:04:58.461780 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 17:04:58.461780 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Jul 14 17:04:58.461780 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 313/637] 10.222.0.136 () {56 vars in 1116 bytes} [Thu Jul 14 17:04:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:04:58.466993 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fd3fea-1857-4229-a574-5339423bbade None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:58.515448 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33da92fc-2cc1-4aa6-bd70-d25038e500b4 None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:58.516067 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33da92fc-2cc1-4aa6-bd70-d25038e500b4 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:58.516547 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33da92fc-2cc1-4aa6-bd70-d25038e500b4 None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:58.518459 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 314/638] 10.222.0.136 () {54 vars in 931 bytes} [Thu Jul 14 17:04:58 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:04:58.523302 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a66ae8-08a1-476b-8d64-54515c2be7ab None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:58.523603 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a66ae8-08a1-476b-8d64-54515c2be7ab None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:58.523890 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a66ae8-08a1-476b-8d64-54515c2be7ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:58.531375 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:58.542613 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-51a66ae8-08a1-476b-8d64-54515c2be7ab None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:04:58.543994 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-51a66ae8-08a1-476b-8d64-54515c2be7ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:04:58.591830 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fd3fea-1857-4229-a574-5339423bbade None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:58.625630 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 315/639] 10.222.0.136 () {58 vars in 1028 bytes} [Thu Jul 14 17:04:58 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 17:04:58.639661 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4e54ea-44e3-4b0c-9e9b-01592e78fe3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:58.640649 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4e54ea-44e3-4b0c-9e9b-01592e78fe3e None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:58.641158 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4e54ea-44e3-4b0c-9e9b-01592e78fe3e None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:58.641650 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4e54ea-44e3-4b0c-9e9b-01592e78fe3e None admin] PATH_INFO: `/v3/projects` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:58.642635 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4e54ea-44e3-4b0c-9e9b-01592e78fe3e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:04:58.643158 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4e54ea-44e3-4b0c-9e9b-01592e78fe3e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:58.645671 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4e54ea-44e3-4b0c-9e9b-01592e78fe3e None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:58.652157 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a66ae8-08a1-476b-8d64-54515c2be7ab None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:58.659371 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 325/640] 10.222.0.136 () {56 vars in 1153 bytes} [Thu Jul 14 17:04:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:04:58.665511 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4e54ea-44e3-4b0c-9e9b-01592e78fe3e None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:58.687534 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:58.773337 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4e54ea-44e3-4b0c-9e9b-01592e78fe3e None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:58.790162 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a66ae8-08a1-476b-8d64-54515c2be7ab None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:58.794033 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:58.819659 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83c5225-c866-46f4-9ddd-fe16c584c398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:58.821449 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83c5225-c866-46f4-9ddd-fe16c584c398 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:58.822000 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83c5225-c866-46f4-9ddd-fe16c584c398 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:58.822777 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83c5225-c866-46f4-9ddd-fe16c584c398 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:58.824101 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83c5225-c866-46f4-9ddd-fe16c584c398 None admin] RBAC: Adding query filter params (role.id=5e0ec7345cc84921907ca95b801a656b, scope.project.id=d57eaa6dbca24cbb99dce1fe3437ecae, user.id=a8c6871e11f047e284afdb16bcb1d3a4) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:04:58.825012 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83c5225-c866-46f4-9ddd-fe16c584c398 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:58.827210 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83c5225-c866-46f4-9ddd-fe16c584c398 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:58.832950 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b356ea51-5b1b-4872-8f7b-3ac84af3ea32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:58.834022 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b356ea51-5b1b-4872-8f7b-3ac84af3ea32 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:58.834376 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b356ea51-5b1b-4872-8f7b-3ac84af3ea32 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:58.834719 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b356ea51-5b1b-4872-8f7b-3ac84af3ea32 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:58.836228 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 326/641] 10.222.0.136 () {56 vars in 1379 bytes} [Thu Jul 14 17:04:58 2022] GET /identity/v3/role_assignments?user.id=a8c6871e11f047e284afdb16bcb1d3a4&scope.project.id=d57eaa6dbca24cbb99dce1fe3437ecae&role.id=5e0ec7345cc84921907ca95b801a656b => generated 610 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:04:58.850833 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b356ea51-5b1b-4872-8f7b-3ac84af3ea32 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 17:04:58.859579 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-b356ea51-5b1b-4872-8f7b-3ac84af3ea32 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 17:04:58.859579 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:04:58.859579 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:04:58.859579 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:04:58.859579 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:04:58.859579 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:04:58.859579 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:04:58.859579 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:04:58.859579 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:04:58.859579 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:04:58.859579 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:04:58.859579 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:04:58.859579 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 17:04:58.859579 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 17:04:58.859579 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 17:04:58.859579 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 17:04:58.860686 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 17:04:58.860686 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 17:04:58.860686 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 17:04:58.860686 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 17:04:58.860686 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:04:58.860686 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:04:58.860686 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:04:58.860686 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:04:58.860686 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:04:58.860686 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:04:58.860686 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:04:58.860686 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Jul 14 17:04:58.860686 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:04:58.860686 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:04:58.860686 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:04:58.860686 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:04:58.861637 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:04:58.861637 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:04:58.861637 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:04:58.861637 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:04:58.861637 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 17:04:58.861637 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 17:04:58.861637 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 17:04:58.861637 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 17:04:58.861637 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 17:04:58.861637 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 17:04:58.861637 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 17:04:58.861637 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Jul 14 17:04:58.861637 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 316/642] 10.222.0.136 () {56 vars in 1101 bytes} [Thu Jul 14 17:04:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 17:04:58.869869 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83c5225-c866-46f4-9ddd-fe16c584c398 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:58.991899 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83c5225-c866-46f4-9ddd-fe16c584c398 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:59.031560 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffda367c-ee62-4949-9fba-8cdb36402e5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:59.033017 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffda367c-ee62-4949-9fba-8cdb36402e5f None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:59.033803 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffda367c-ee62-4949-9fba-8cdb36402e5f None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:59.034316 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffda367c-ee62-4949-9fba-8cdb36402e5f None admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:59.035316 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffda367c-ee62-4949-9fba-8cdb36402e5f None admin] RBAC: Adding query filter params (name=admin) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:04:59.035856 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffda367c-ee62-4949-9fba-8cdb36402e5f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:59.037437 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffda367c-ee62-4949-9fba-8cdb36402e5f None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:59.046932 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 327/643] 10.222.0.136 () {56 vars in 1104 bytes} [Thu Jul 14 17:04:58 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:04:59.052927 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b356ea51-5b1b-4872-8f7b-3ac84af3ea32 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:59.148516 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:59.161684 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b356ea51-5b1b-4872-8f7b-3ac84af3ea32 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:59.203554 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed61c0b-d9f9-4490-83bf-89ae0b27a86d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:59.204424 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed61c0b-d9f9-4490-83bf-89ae0b27a86d None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:59.204717 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed61c0b-d9f9-4490-83bf-89ae0b27a86d None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:59.205003 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed61c0b-d9f9-4490-83bf-89ae0b27a86d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:59.223468 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed61c0b-d9f9-4490-83bf-89ae0b27a86d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:59.224670 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed61c0b-d9f9-4490-83bf-89ae0b27a86d None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:59.245474 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-8ed61c0b-d9f9-4490-83bf-89ae0b27a86d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:04:59.245474 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:04:59.245474 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:04:59.245474 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:04:59.245474 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:04:59.245474 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:04:59.245474 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:04:59.245474 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:04:59.245474 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:04:59.245474 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:04:59.245474 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:04:59.245474 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:04:59.245474 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 17:04:59.245474 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 17:04:59.245474 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 17:04:59.246476 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 17:04:59.246476 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:04:59.246476 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:04:59.246476 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:04:59.246476 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:04:59.246476 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:04:59.246476 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:04:59.246476 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:04:59.246476 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Jul 14 17:04:59.246476 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:04:59.246476 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:04:59.246476 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:04:59.246476 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:04:59.246476 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:04:59.246476 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:04:59.246476 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:04:59.246476 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:04:59.247364 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 17:04:59.247364 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 17:04:59.247364 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:04:59.247364 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Jul 14 17:04:59.249652 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 317/644] 10.222.0.136 () {56 vars in 1113 bytes} [Thu Jul 14 17:04:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:04:59.255927 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffda367c-ee62-4949-9fba-8cdb36402e5f None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:59.293951 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:59.364207 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffda367c-ee62-4949-9fba-8cdb36402e5f None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:59.400493 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7addf16b-c20c-4ecb-bf7d-52a59bf180dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:59.401164 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7addf16b-c20c-4ecb-bf7d-52a59bf180dd None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:59.401452 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7addf16b-c20c-4ecb-bf7d-52a59bf180dd None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:59.401772 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7addf16b-c20c-4ecb-bf7d-52a59bf180dd None admin] PATH_INFO: `/v3/domains` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:59.402507 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7addf16b-c20c-4ecb-bf7d-52a59bf180dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:04:59.402823 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7addf16b-c20c-4ecb-bf7d-52a59bf180dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:59.404254 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7addf16b-c20c-4ecb-bf7d-52a59bf180dd None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:59.417212 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 328/645] 10.222.0.136 () {56 vars in 1114 bytes} [Thu Jul 14 17:04:59 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:04:59.422630 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed61c0b-d9f9-4490-83bf-89ae0b27a86d None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:59.529994 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed61c0b-d9f9-4490-83bf-89ae0b27a86d None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:59.564856 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd2c061-058f-429e-b5dd-6bb878258c24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:59.565595 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd2c061-058f-429e-b5dd-6bb878258c24 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:59.565888 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd2c061-058f-429e-b5dd-6bb878258c24 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:59.566300 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd2c061-058f-429e-b5dd-6bb878258c24 None admin] PATH_INFO: `/v3/users/nova` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:59.574448 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd2c061-058f-429e-b5dd-6bb878258c24 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:59.575970 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd2c061-058f-429e-b5dd-6bb878258c24 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:59.578551 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:59.591588 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-9bd2c061-058f-429e-b5dd-6bb878258c24 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 14 17:04:59.591588 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:04:59.591588 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:04:59.591588 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:04:59.591588 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:04:59.591588 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:04:59.591588 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:04:59.591588 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:04:59.591588 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:04:59.591588 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:04:59.591588 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:04:59.591588 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:04:59.591588 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 17:04:59.591588 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 17:04:59.591588 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 17:04:59.591588 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 17:04:59.592772 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:04:59.592772 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:04:59.592772 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 17:04:59.592772 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 17:04:59.592772 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 17:04:59.592772 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 17:04:59.592772 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:04:59.592772 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:04:59.592772 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:04:59.592772 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:04:59.592772 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:04:59.592772 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Jul 14 17:04:59.592772 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:04:59.592772 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:04:59.592772 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:04:59.592772 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:04:59.592772 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:04:59.592772 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:04:59.593929 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:04:59.593929 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:04:59.593929 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 17:04:59.593929 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 17:04:59.593929 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 17:04:59.593929 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 17:04:59.593929 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 17:04:59.593929 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 17:04:59.593929 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 14 17:04:59.593929 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Jul 14 17:04:59.595480 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 318/646] 10.222.0.136 () {56 vars in 1098 bytes} [Thu Jul 14 17:04:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 17:04:59.600986 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7addf16b-c20c-4ecb-bf7d-52a59bf180dd None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:59.703081 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:04:59.709405 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7addf16b-c20c-4ecb-bf7d-52a59bf180dd None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:04:59.865093 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c71444-99ef-4f14-8da9-49d7bc552a76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:04:59.865721 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c71444-99ef-4f14-8da9-49d7bc552a76 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:59.866009 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c71444-99ef-4f14-8da9-49d7bc552a76 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:59.866293 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c71444-99ef-4f14-8da9-49d7bc552a76 None admin] PATH_INFO: `/v3/users` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:59.867137 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c71444-99ef-4f14-8da9-49d7bc552a76 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:04:59.867451 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c71444-99ef-4f14-8da9-49d7bc552a76 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:04:59.868888 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c71444-99ef-4f14-8da9-49d7bc552a76 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:04:59.887948 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 329/647] 10.222.0.136 () {56 vars in 1138 bytes} [Thu Jul 14 17:04:59 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:04:59.893392 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd2c061-058f-429e-b5dd-6bb878258c24 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:04:59.967795 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a298736e-eb62-4429-af49-cae0ddd6ed0d None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:59.968115 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a298736e-eb62-4429-af49-cae0ddd6ed0d None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:59.968380 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a298736e-eb62-4429-af49-cae0ddd6ed0d None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:04:59.970106 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 330/648] 10.222.0.136 () {54 vars in 931 bytes} [Thu Jul 14 17:04:59 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:04:59.978981 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8b0130-52f6-4d00-a82a-d85581ea5005 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:04:59.979661 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8b0130-52f6-4d00-a82a-d85581ea5005 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:04:59.979661 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8b0130-52f6-4d00-a82a-d85581ea5005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:00.000435 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-ea8b0130-52f6-4d00-a82a-d85581ea5005 None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:05:00.001820 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-ea8b0130-52f6-4d00-a82a-d85581ea5005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:05:00.005882 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd2c061-058f-429e-b5dd-6bb878258c24 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:05:00.042645 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cc91f7-2ed1-400b-b88e-e3c6a6f3ca7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:05:00.043649 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cc91f7-2ed1-400b-b88e-e3c6a6f3ca7f None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:00.044075 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cc91f7-2ed1-400b-b88e-e3c6a6f3ca7f None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:00.044508 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cc91f7-2ed1-400b-b88e-e3c6a6f3ca7f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:00.085582 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 331/649] 10.222.0.136 () {58 vars in 1028 bytes} [Thu Jul 14 17:04:59 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 17:05:00.107790 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8b0130-52f6-4d00-a82a-d85581ea5005 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:05:00.125521 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:05:00.128226 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cc91f7-2ed1-400b-b88e-e3c6a6f3ca7f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:05:00.130942 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cc91f7-2ed1-400b-b88e-e3c6a6f3ca7f None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:05:00.219939 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:05:00.240370 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8b0130-52f6-4d00-a82a-d85581ea5005 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:05:00.250362 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 319/650] 10.222.0.136 () {58 vars in 1287 bytes} [Thu Jul 14 17:04:59 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 17:05:00.253428 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cc91f7-2ed1-400b-b88e-e3c6a6f3ca7f None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:05:00.294617 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9b2887-8199-4235-84d4-6b4f84e80a01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:05:00.295451 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9b2887-8199-4235-84d4-6b4f84e80a01 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:00.295872 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9b2887-8199-4235-84d4-6b4f84e80a01 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:00.296154 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9b2887-8199-4235-84d4-6b4f84e80a01 None admin] PATH_INFO: `/v3/services/image` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:00.296810 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9b2887-8199-4235-84d4-6b4f84e80a01 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:05:00.298844 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9b2887-8199-4235-84d4-6b4f84e80a01 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:05:00.315689 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-3b9b2887-8199-4235-84d4-6b4f84e80a01 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 14 17:05:00.315689 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:05:00.315689 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 17:05:00.315689 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 17:05:00.315689 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 17:05:00.315689 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 17:05:00.315689 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 17:05:00.315689 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 17:05:00.315689 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 14 17:05:00.315689 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Jul 14 17:05:00.315689 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 17:05:00.315689 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Jul 14 17:05:00.315689 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:05:00.315689 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:05:00.315689 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:05:00.315689 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:05:00.315689 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:05:00.317536 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:05:00.317536 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:05:00.317536 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:05:00.317536 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:05:00.317536 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:05:00.317536 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:05:00.317536 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 17:05:00.317536 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 17:05:00.317536 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 17:05:00.317536 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 17:05:00.317536 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:05:00.317536 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:05:00.317536 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:05:00.317536 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:05:00.317536 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:05:00.317536 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:05:00.318447 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:05:00.318447 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Jul 14 17:05:00.318447 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:05:00.318447 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:05:00.318447 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:05:00.318447 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:05:00.318447 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:05:00.318447 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:05:00.318447 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:05:00.318447 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:05:00.318447 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 17:05:00.318447 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 17:05:00.318447 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 14 17:05:00.318447 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Jul 14 17:05:00.321683 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 332/651] 10.222.0.136 () {56 vars in 1110 bytes} [Thu Jul 14 17:05:00 2022] GET /identity/v3/services/image => generated 86 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:05:00.325708 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9b2887-8199-4235-84d4-6b4f84e80a01 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:05:00.381382 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:05:00.384135 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cc91f7-2ed1-400b-b88e-e3c6a6f3ca7f None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:05:00.420915 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90faf63-ee07-4e8a-b5f7-cf6ec9254e62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:05:00.421525 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90faf63-ee07-4e8a-b5f7-cf6ec9254e62 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:00.421834 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90faf63-ee07-4e8a-b5f7-cf6ec9254e62 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:00.422114 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90faf63-ee07-4e8a-b5f7-cf6ec9254e62 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:00.432652 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90faf63-ee07-4e8a-b5f7-cf6ec9254e62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:05:00.434121 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90faf63-ee07-4e8a-b5f7-cf6ec9254e62 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:05:00.446633 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9b2887-8199-4235-84d4-6b4f84e80a01 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:05:00.451870 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-c90faf63-ee07-4e8a-b5f7-cf6ec9254e62 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:05:00.451870 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:05:00.451870 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:05:00.451870 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:05:00.451870 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:05:00.451870 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:05:00.451870 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:05:00.451870 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:05:00.451870 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:05:00.451870 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:05:00.451870 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:05:00.451870 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:05:00.451870 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 17:05:00.451870 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 17:05:00.451870 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 17:05:00.452780 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 17:05:00.452780 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:05:00.452780 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:05:00.452780 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:05:00.452780 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:05:00.452780 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:05:00.452780 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:05:00.452780 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:05:00.452780 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Jul 14 17:05:00.452780 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:05:00.452780 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:05:00.452780 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:05:00.452780 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:05:00.452780 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:05:00.452780 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:05:00.452780 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:05:00.452780 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:05:00.453720 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 17:05:00.453720 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 17:05:00.453720 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:05:00.453720 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Jul 14 17:05:00.458752 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 320/652] 10.222.0.136 () {56 vars in 1113 bytes} [Thu Jul 14 17:05:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:05:00.460369 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90faf63-ee07-4e8a-b5f7-cf6ec9254e62 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:05:00.492832 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0be823-8343-462a-8dac-b77e19e9f4ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:05:00.493938 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0be823-8343-462a-8dac-b77e19e9f4ce None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:00.494379 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0be823-8343-462a-8dac-b77e19e9f4ce None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:00.494949 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0be823-8343-462a-8dac-b77e19e9f4ce None admin] PATH_INFO: `/v3/services` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:00.495909 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0be823-8343-462a-8dac-b77e19e9f4ce None admin] RBAC: Adding query filter params (name=image) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:05:00.496469 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0be823-8343-462a-8dac-b77e19e9f4ce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:05:00.498212 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0be823-8343-462a-8dac-b77e19e9f4ce None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:05:00.504455 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 333/653] 10.222.0.136 () {56 vars in 1113 bytes} [Thu Jul 14 17:05:00 2022] GET /identity/v3/services?name=image => generated 123 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:05:00.510531 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0be823-8343-462a-8dac-b77e19e9f4ce None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:05:00.529423 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:05:00.600893 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90faf63-ee07-4e8a-b5f7-cf6ec9254e62 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:05:00.647150 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0be823-8343-462a-8dac-b77e19e9f4ce None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:05:00.650628 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d87e78-0f1f-4d51-8a00-e2cafcfb691d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:05:00.651312 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d87e78-0f1f-4d51-8a00-e2cafcfb691d None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:00.651602 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d87e78-0f1f-4d51-8a00-e2cafcfb691d None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:00.651887 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d87e78-0f1f-4d51-8a00-e2cafcfb691d None admin] PATH_INFO: `/v3/domains` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:00.652616 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d87e78-0f1f-4d51-8a00-e2cafcfb691d None admin] RBAC: Adding query filter params (name=Default) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:05:00.652931 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d87e78-0f1f-4d51-8a00-e2cafcfb691d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:05:00.654360 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d87e78-0f1f-4d51-8a00-e2cafcfb691d None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:05:00.667520 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 321/654] 10.222.0.136 () {56 vars in 1114 bytes} [Thu Jul 14 17:05:00 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 17:05:00.669580 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b940682d-c460-45db-a10c-cb204ed940db None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:00.670106 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b940682d-c460-45db-a10c-cb204ed940db None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:00.670874 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b940682d-c460-45db-a10c-cb204ed940db None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:00.672512 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 322/655] 10.222.0.136 () {54 vars in 931 bytes} [Thu Jul 14 17:05:00 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:05:00.674035 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b940682d-c460-45db-a10c-cb204ed940db None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:05:00.685058 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f688b2-797c-4730-8ae0-d4b473eec338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:05:00.685789 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f688b2-797c-4730-8ae0-d4b473eec338 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:00.686052 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f688b2-797c-4730-8ae0-d4b473eec338 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:00.686328 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f688b2-797c-4730-8ae0-d4b473eec338 None admin] PATH_INFO: `/v3/services` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:00.687070 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f688b2-797c-4730-8ae0-d4b473eec338 None admin] RBAC: Adding query filter params (type=image) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:05:00.687355 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f688b2-797c-4730-8ae0-d4b473eec338 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:05:00.688714 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f688b2-797c-4730-8ae0-d4b473eec338 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:05:00.692371 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:05:00.696036 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 334/656] 10.222.0.136 () {56 vars in 1113 bytes} [Thu Jul 14 17:05:00 2022] GET /identity/v3/services?type=image => generated 123 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:05:00.697597 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa7d098-e152-45ad-ae69-5d54e438d544 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:00.697816 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa7d098-e152-45ad-ae69-5d54e438d544 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:00.698255 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa7d098-e152-45ad-ae69-5d54e438d544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:00.727220 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-9aa7d098-e152-45ad-ae69-5d54e438d544 None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:05:00.728553 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-9aa7d098-e152-45ad-ae69-5d54e438d544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:05:00.809815 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b940682d-c460-45db-a10c-cb204ed940db None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:05:00.836581 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 335/657] 10.222.0.136 () {58 vars in 1028 bytes} [Thu Jul 14 17:05:00 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 17:05:00.862943 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e062efc3-83ce-452b-9a53-e3095b0e1a24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:05:00.864619 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e062efc3-83ce-452b-9a53-e3095b0e1a24 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:00.865067 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e062efc3-83ce-452b-9a53-e3095b0e1a24 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:00.865498 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e062efc3-83ce-452b-9a53-e3095b0e1a24 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:00.867996 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa7d098-e152-45ad-ae69-5d54e438d544 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:05:00.875521 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e062efc3-83ce-452b-9a53-e3095b0e1a24 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:05:00.877329 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e062efc3-83ce-452b-9a53-e3095b0e1a24 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:05:00.878044 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:05:00.897097 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-e062efc3-83ce-452b-9a53-e3095b0e1a24 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 17:05:00.897097 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:05:00.897097 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:05:00.897097 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:05:00.897097 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:05:00.897097 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:05:00.897097 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:05:00.897097 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:05:00.897097 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:05:00.897097 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:05:00.897097 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:05:00.897097 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:05:00.897097 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 17:05:00.897097 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 17:05:00.897097 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 17:05:00.898341 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 17:05:00.898341 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:05:00.898341 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:05:00.898341 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:05:00.898341 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:05:00.898341 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:05:00.898341 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:05:00.898341 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:05:00.898341 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Jul 14 17:05:00.898341 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:05:00.898341 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:05:00.898341 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:05:00.898341 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:05:00.898341 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:05:00.898341 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:05:00.898341 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:05:00.898341 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:05:00.899253 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 17:05:00.899253 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 17:05:00.899253 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 17:05:00.899253 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 17:05:00.899253 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 17:05:00.899253 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 17:05:00.899253 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 17:05:00.899253 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Jul 14 17:05:00.899253 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 323/658] 10.222.0.136 () {56 vars in 1116 bytes} [Thu Jul 14 17:05:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:05:00.903964 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e062efc3-83ce-452b-9a53-e3095b0e1a24 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:05:00.995320 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:05:01.018618 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa7d098-e152-45ad-ae69-5d54e438d544 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:05:01.032049 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e062efc3-83ce-452b-9a53-e3095b0e1a24 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:05:01.067904 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0676361d-979f-4cf7-a144-a9be6a7c88a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:05:01.068988 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0676361d-979f-4cf7-a144-a9be6a7c88a1 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:01.069279 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0676361d-979f-4cf7-a144-a9be6a7c88a1 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:01.069579 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0676361d-979f-4cf7-a144-a9be6a7c88a1 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:01.070253 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0676361d-979f-4cf7-a144-a9be6a7c88a1 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:05:01.071916 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0676361d-979f-4cf7-a144-a9be6a7c88a1 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:05:01.074001 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcd8253-7c9a-4ad1-bbb9-0ce969dba130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:05:01.074964 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcd8253-7c9a-4ad1-bbb9-0ce969dba130 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:01.075508 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcd8253-7c9a-4ad1-bbb9-0ce969dba130 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:01.075985 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcd8253-7c9a-4ad1-bbb9-0ce969dba130 None admin] PATH_INFO: `/v3/projects` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:01.077032 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcd8253-7c9a-4ad1-bbb9-0ce969dba130 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:05:01.077575 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcd8253-7c9a-4ad1-bbb9-0ce969dba130 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:05:01.079242 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcd8253-7c9a-4ad1-bbb9-0ce969dba130 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:05:01.086050 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-0676361d-979f-4cf7-a144-a9be6a7c88a1 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 14 17:05:01.086050 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:05:01.086050 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 17:05:01.086050 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 17:05:01.086050 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 17:05:01.086050 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 17:05:01.086050 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 17:05:01.086050 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 17:05:01.086050 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 14 17:05:01.086050 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Jul 14 17:05:01.086050 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 17:05:01.086050 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Jul 14 17:05:01.086050 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:05:01.086050 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:05:01.086050 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:05:01.086050 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:05:01.087356 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:05:01.087356 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:05:01.087356 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:05:01.087356 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:05:01.087356 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:05:01.087356 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:05:01.087356 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:05:01.087356 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 17:05:01.087356 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 17:05:01.087356 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 17:05:01.087356 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 17:05:01.087356 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:05:01.087356 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:05:01.087356 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:05:01.087356 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:05:01.087356 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:05:01.088232 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:05:01.088232 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:05:01.088232 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Jul 14 17:05:01.088232 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:05:01.088232 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:05:01.088232 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:05:01.088232 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:05:01.088232 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:05:01.088232 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:05:01.088232 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:05:01.088232 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:05:01.088232 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 17:05:01.088232 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 17:05:01.088232 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 14 17:05:01.088232 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Jul 14 17:05:01.092661 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 336/659] 10.222.0.136 () {56 vars in 1134 bytes} [Thu Jul 14 17:05:00 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 17:05:01.093523 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0676361d-979f-4cf7-a144-a9be6a7c88a1 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:05:01.099059 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 324/660] 10.222.0.136 () {56 vars in 1153 bytes} [Thu Jul 14 17:05:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 17:05:01.106061 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcd8253-7c9a-4ad1-bbb9-0ce969dba130 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:05:01.201513 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:05:01.244784 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcd8253-7c9a-4ad1-bbb9-0ce969dba130 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:05:01.245299 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0676361d-979f-4cf7-a144-a9be6a7c88a1 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:05:01.284265 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:05:01.293137 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8ee72e-a5d6-46cf-b842-2501944ddab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:05:01.293835 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8ee72e-a5d6-46cf-b842-2501944ddab7 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:01.294122 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8ee72e-a5d6-46cf-b842-2501944ddab7 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:01.294398 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8ee72e-a5d6-46cf-b842-2501944ddab7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:01.294684 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a150ca7-cb4b-41e3-a207-645d54ea8a30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:05:01.295229 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8ee72e-a5d6-46cf-b842-2501944ddab7 None admin] RBAC: Adding query filter params (role.id=284c6314b4d3492085e397a87b0e3b51, scope.project.id=d57eaa6dbca24cbb99dce1fe3437ecae, user.id=bc2b7d015c2046ddacac6e682f22d0f5) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:05:01.295354 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a150ca7-cb4b-41e3-a207-645d54ea8a30 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:01.295547 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8ee72e-a5d6-46cf-b842-2501944ddab7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:05:01.295651 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a150ca7-cb4b-41e3-a207-645d54ea8a30 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:01.295896 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a150ca7-cb4b-41e3-a207-645d54ea8a30 None admin] PATH_INFO: `/v3/services` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:01.296611 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a150ca7-cb4b-41e3-a207-645d54ea8a30 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:05:01.296950 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a150ca7-cb4b-41e3-a207-645d54ea8a30 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:05:01.297112 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8ee72e-a5d6-46cf-b842-2501944ddab7 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:05:01.298333 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a150ca7-cb4b-41e3-a207-645d54ea8a30 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:05:01.309744 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 325/661] 10.222.0.136 () {56 vars in 1379 bytes} [Thu Jul 14 17:05:01 2022] GET /identity/v3/role_assignments?user.id=bc2b7d015c2046ddacac6e682f22d0f5&scope.project.id=d57eaa6dbca24cbb99dce1fe3437ecae&role.id=284c6314b4d3492085e397a87b0e3b51 => generated 260 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 17:05:01.309744 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3007b628-97eb-4faa-b30e-4dc4e49cd135 None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:01.309744 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3007b628-97eb-4faa-b30e-4dc4e49cd135 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:01.309744 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3007b628-97eb-4faa-b30e-4dc4e49cd135 None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:01.310135 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 337/662] 10.222.0.136 () {56 vars in 1129 bytes} [Thu Jul 14 17:05:01 2022] GET /identity/v3/services?name=block-storage => generated 131 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:05:01.310135 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a150ca7-cb4b-41e3-a207-645d54ea8a30 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:05:01.311213 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 326/663] 10.222.0.136 () {54 vars in 931 bytes} [Thu Jul 14 17:05:01 2022] GET /identity => generated 271 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:05:01.312634 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16963202-80ea-480c-9ed2-2786f38baf73 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:01.312926 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16963202-80ea-480c-9ed2-2786f38baf73 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:01.313273 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16963202-80ea-480c-9ed2-2786f38baf73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:01.333005 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-16963202-80ea-480c-9ed2-2786f38baf73 None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:05:01.334604 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-16963202-80ea-480c-9ed2-2786f38baf73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:05:01.430095 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a150ca7-cb4b-41e3-a207-645d54ea8a30 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:05:01.434180 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 327/664] 10.222.0.136 () {58 vars in 1028 bytes} [Thu Jul 14 17:05:01 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 17:05:01.462815 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16963202-80ea-480c-9ed2-2786f38baf73 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:05:01.481738 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca569493-dfc2-4f32-8704-219a1fbdbe3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:05:01.482417 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca569493-dfc2-4f32-8704-219a1fbdbe3d None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:01.482702 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca569493-dfc2-4f32-8704-219a1fbdbe3d None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:01.482980 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca569493-dfc2-4f32-8704-219a1fbdbe3d None admin] PATH_INFO: `/v3/services` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:01.483696 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca569493-dfc2-4f32-8704-219a1fbdbe3d None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:05:01.484005 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca569493-dfc2-4f32-8704-219a1fbdbe3d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:05:01.485392 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca569493-dfc2-4f32-8704-219a1fbdbe3d None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:05:01.486889 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:05:01.492487 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 338/665] 10.222.0.136 () {56 vars in 1129 bytes} [Thu Jul 14 17:05:01 2022] GET /identity/v3/services?type=block-storage => generated 131 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:05:01.593380 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16963202-80ea-480c-9ed2-2786f38baf73 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:05:01.627489 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:05:01.638790 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0015427d-ca5e-4cc8-841f-6ebf7392dacb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:05:01.639612 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0015427d-ca5e-4cc8-841f-6ebf7392dacb None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:01.639897 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0015427d-ca5e-4cc8-841f-6ebf7392dacb None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:01.640177 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0015427d-ca5e-4cc8-841f-6ebf7392dacb None admin] PATH_INFO: `/v3/services/network` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:01.640872 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0015427d-ca5e-4cc8-841f-6ebf7392dacb None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:05:01.642279 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0015427d-ca5e-4cc8-841f-6ebf7392dacb None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:05:01.657622 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-0015427d-ca5e-4cc8-841f-6ebf7392dacb None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 14 17:05:01.657622 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:05:01.657622 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 17:05:01.657622 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 17:05:01.657622 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 17:05:01.657622 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 17:05:01.657622 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 17:05:01.657622 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 17:05:01.657622 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 14 17:05:01.657622 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Jul 14 17:05:01.657622 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 17:05:01.657622 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Jul 14 17:05:01.657622 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:05:01.657622 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:05:01.657622 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:05:01.657622 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:05:01.657622 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:05:01.658708 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:05:01.658708 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:05:01.658708 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:05:01.658708 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:05:01.658708 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:05:01.658708 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:05:01.658708 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 17:05:01.658708 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 17:05:01.658708 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 17:05:01.658708 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 17:05:01.658708 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:05:01.658708 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:05:01.658708 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:05:01.658708 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:05:01.658708 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:05:01.658708 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:05:01.659545 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:05:01.659545 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Jul 14 17:05:01.659545 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:05:01.659545 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:05:01.659545 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:05:01.659545 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:05:01.659545 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:05:01.659545 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:05:01.659545 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:05:01.659545 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:05:01.659545 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 17:05:01.659545 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 17:05:01.659545 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 14 17:05:01.659545 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Jul 14 17:05:01.659545 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 328/666] 10.222.0.136 () {56 vars in 1116 bytes} [Thu Jul 14 17:05:01 2022] GET /identity/v3/services/network => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:05:01.665337 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca569493-dfc2-4f32-8704-219a1fbdbe3d None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:05:01.784544 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca569493-dfc2-4f32-8704-219a1fbdbe3d None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:05:01.823213 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cab628-03c1-49a0-9880-1e0aae59c65a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:05:01.823923 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cab628-03c1-49a0-9880-1e0aae59c65a None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:01.824222 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cab628-03c1-49a0-9880-1e0aae59c65a None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:01.824502 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cab628-03c1-49a0-9880-1e0aae59c65a None admin] PATH_INFO: `/v3/services` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:01.825215 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cab628-03c1-49a0-9880-1e0aae59c65a None admin] RBAC: Adding query filter params (name=network) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:05:01.825521 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cab628-03c1-49a0-9880-1e0aae59c65a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:05:01.826975 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cab628-03c1-49a0-9880-1e0aae59c65a None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:05:01.832439 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 339/667] 10.222.0.136 () {56 vars in 1117 bytes} [Thu Jul 14 17:05:01 2022] GET /identity/v3/services?name=network => generated 125 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:05:01.837906 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0015427d-ca5e-4cc8-841f-6ebf7392dacb None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:05:01.970820 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0015427d-ca5e-4cc8-841f-6ebf7392dacb None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:05:02.010585 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4700fd-4a0f-495b-bf30-9f349c131bc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:05:02.011264 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4700fd-4a0f-495b-bf30-9f349c131bc9 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:02.011553 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4700fd-4a0f-495b-bf30-9f349c131bc9 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:02.011836 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4700fd-4a0f-495b-bf30-9f349c131bc9 None admin] PATH_INFO: `/v3/services` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:02.012543 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4700fd-4a0f-495b-bf30-9f349c131bc9 None admin] RBAC: Adding query filter params (type=network) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:05:02.012851 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4700fd-4a0f-495b-bf30-9f349c131bc9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:05:02.014318 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4700fd-4a0f-495b-bf30-9f349c131bc9 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:05:02.021072 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 329/668] 10.222.0.136 () {56 vars in 1117 bytes} [Thu Jul 14 17:05:01 2022] GET /identity/v3/services?type=network => generated 125 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:05:03.066880 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6c116f-64df-434f-83e2-23c53bd6b04e None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:03.067633 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6c116f-64df-434f-83e2-23c53bd6b04e None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:03.067633 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6c116f-64df-434f-83e2-23c53bd6b04e None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:03.069010 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 340/669] 10.222.0.136 () {54 vars in 931 bytes} [Thu Jul 14 17:05:03 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:05:03.074449 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f059b3fa-c7eb-4d7b-980d-b8ee660933b1 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:03.074845 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f059b3fa-c7eb-4d7b-980d-b8ee660933b1 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:03.075027 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f059b3fa-c7eb-4d7b-980d-b8ee660933b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:03.093801 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-f059b3fa-c7eb-4d7b-980d-b8ee660933b1 None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:05:03.094989 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-f059b3fa-c7eb-4d7b-980d-b8ee660933b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:05:03.162018 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:05:03.182792 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 330/670] 10.222.0.136 () {58 vars in 1028 bytes} [Thu Jul 14 17:05:03 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 17:05:03.207154 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6c116f-64df-434f-83e2-23c53bd6b04e None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:05:03.289004 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:05:03.335356 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6c116f-64df-434f-83e2-23c53bd6b04e None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:05:03.372649 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169e5ba6-57c2-4e8c-be73-5a233a4e5741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:05:03.373707 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169e5ba6-57c2-4e8c-be73-5a233a4e5741 None admin] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:03.374217 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169e5ba6-57c2-4e8c-be73-5a233a4e5741 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:03.374687 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169e5ba6-57c2-4e8c-be73-5a233a4e5741 None admin] PATH_INFO: `/v3/services` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:03.375613 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169e5ba6-57c2-4e8c-be73-5a233a4e5741 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:05:03.377221 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169e5ba6-57c2-4e8c-be73-5a233a4e5741 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:05:03.395724 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 341/671] 10.222.0.136 () {60 vars in 1146 bytes} [Thu Jul 14 17:05:03 2022] POST /identity/v3/services => generated 243 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 17:05:03.700645 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d699095-130f-4921-9b7c-bf6cbbce356e None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:03.701029 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d699095-130f-4921-9b7c-bf6cbbce356e None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:03.701226 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d699095-130f-4921-9b7c-bf6cbbce356e None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:03.702867 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 331/672] 10.222.0.136 () {54 vars in 931 bytes} [Thu Jul 14 17:05:03 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:05:03.708409 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb714fb4-7785-4d5b-a2a3-84c7a6aa687f None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:03.708972 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb714fb4-7785-4d5b-a2a3-84c7a6aa687f None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:03.709481 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb714fb4-7785-4d5b-a2a3-84c7a6aa687f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:03.727334 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-cb714fb4-7785-4d5b-a2a3-84c7a6aa687f None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:05:03.728865 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-cb714fb4-7785-4d5b-a2a3-84c7a6aa687f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:05:03.819665 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 342/673] 10.222.0.136 () {58 vars in 1028 bytes} [Thu Jul 14 17:05:03 2022] POST /identity/v3/auth/tokens => generated 896 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 17:05:03.843965 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d699095-130f-4921-9b7c-bf6cbbce356e None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:05:03.935052 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5d3636-82c5-4ccb-b802-61c4bdc1140f None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:03.935423 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5d3636-82c5-4ccb-b802-61c4bdc1140f None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:03.935615 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5d3636-82c5-4ccb-b802-61c4bdc1140f None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:03.937248 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 343/674] 10.222.0.136 () {54 vars in 931 bytes} [Thu Jul 14 17:05:03 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 14 17:05:03.943269 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e19412-b1c7-4489-b251-f0c3b1e22cbf None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:03.943557 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e19412-b1c7-4489-b251-f0c3b1e22cbf None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:03.943839 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e19412-b1c7-4489-b251-f0c3b1e22cbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:03.961625 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d699095-130f-4921-9b7c-bf6cbbce356e None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:05:03.967194 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-37e19412-b1c7-4489-b251-f0c3b1e22cbf None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:05:03.968608 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-37e19412-b1c7-4489-b251-f0c3b1e22cbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:05:03.998667 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0014c49b-4f35-43fe-83ca-00601a93b081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:05:03.999466 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0014c49b-4f35-43fe-83ca-00601a93b081 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:03.999750 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0014c49b-4f35-43fe-83ca-00601a93b081 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:04.000026 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0014c49b-4f35-43fe-83ca-00601a93b081 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:04.011518 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0014c49b-4f35-43fe-83ca-00601a93b081 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 17:05:04.019796 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-0014c49b-4f35-43fe-83ca-00601a93b081 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 17:05:04.019796 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:05:04.019796 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:05:04.019796 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:05:04.019796 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:05:04.019796 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:05:04.019796 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:05:04.019796 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:05:04.019796 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:05:04.019796 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:05:04.019796 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:05:04.019796 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:05:04.019796 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 17:05:04.019796 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 17:05:04.019796 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 17:05:04.019796 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 17:05:04.020748 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 17:05:04.020748 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 17:05:04.020748 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 17:05:04.020748 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 17:05:04.020748 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:05:04.020748 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:05:04.020748 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:05:04.020748 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:05:04.020748 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:05:04.020748 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:05:04.020748 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:05:04.020748 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Jul 14 17:05:04.020748 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:05:04.020748 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:05:04.020748 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:05:04.020748 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:05:04.021650 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:05:04.021650 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:05:04.021650 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:05:04.021650 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:05:04.021650 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 17:05:04.021650 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 17:05:04.021650 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 17:05:04.021650 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 17:05:04.021650 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 17:05:04.021650 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 17:05:04.021650 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 17:05:04.021650 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Jul 14 17:05:04.025934 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 332/675] 10.222.0.136 () {56 vars in 1101 bytes} [Thu Jul 14 17:05:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:05:04.026796 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0014c49b-4f35-43fe-83ca-00601a93b081 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:05:04.033617 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:05:04.075139 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 344/676] 10.222.0.136 () {58 vars in 1028 bytes} [Thu Jul 14 17:05:03 2022] POST /identity/v3/auth/tokens => generated 896 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 17:05:04.089587 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:05:04.103504 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e19412-b1c7-4489-b251-f0c3b1e22cbf None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:05:04.145039 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0014c49b-4f35-43fe-83ca-00601a93b081 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:05:04.180598 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d455e2-187d-4028-8141-4a489f6121f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:05:04.181275 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d455e2-187d-4028-8141-4a489f6121f5 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:04.181573 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d455e2-187d-4028-8141-4a489f6121f5 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:04.181864 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d455e2-187d-4028-8141-4a489f6121f5 None admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:04.182611 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d455e2-187d-4028-8141-4a489f6121f5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:05:04.182915 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d455e2-187d-4028-8141-4a489f6121f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:05:04.184285 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d455e2-187d-4028-8141-4a489f6121f5 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:05:04.193342 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 333/677] 10.222.0.136 () {56 vars in 1104 bytes} [Thu Jul 14 17:05:04 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:05:04.198780 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d455e2-187d-4028-8141-4a489f6121f5 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:05:04.227314 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e19412-b1c7-4489-b251-f0c3b1e22cbf None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:05:04.271112 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc77fb3-65e4-4a99-b9fb-3c4977f97839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:05:04.272150 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc77fb3-65e4-4a99-b9fb-3c4977f97839 None admin] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:04.272657 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc77fb3-65e4-4a99-b9fb-3c4977f97839 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:04.273088 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc77fb3-65e4-4a99-b9fb-3c4977f97839 None admin] PATH_INFO: `/v3/services` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:04.274132 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc77fb3-65e4-4a99-b9fb-3c4977f97839 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:05:04.275827 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc77fb3-65e4-4a99-b9fb-3c4977f97839 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:05:04.295116 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 345/678] 10.222.0.136 () {60 vars in 1146 bytes} [Thu Jul 14 17:05:04 2022] POST /identity/v3/services => generated 252 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 17:05:04.326869 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d455e2-187d-4028-8141-4a489f6121f5 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:05:04.336924 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:05:04.376702 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd24b3c-73d1-4b16-bce2-d12f830accec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:05:04.377866 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd24b3c-73d1-4b16-bce2-d12f830accec None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:04.378831 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd24b3c-73d1-4b16-bce2-d12f830accec None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:04.379263 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd24b3c-73d1-4b16-bce2-d12f830accec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:04.393356 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd24b3c-73d1-4b16-bce2-d12f830accec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:05:04.395233 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd24b3c-73d1-4b16-bce2-d12f830accec None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:05:04.419413 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-ebd24b3c-73d1-4b16-bce2-d12f830accec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:05:04.419413 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:05:04.419413 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:05:04.419413 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:05:04.419413 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:05:04.419413 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:05:04.419413 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:05:04.419413 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:05:04.419413 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:05:04.419413 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:05:04.419413 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:05:04.419413 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:05:04.419413 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 17:05:04.419413 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 17:05:04.419413 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 17:05:04.420581 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 17:05:04.420581 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:05:04.420581 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:05:04.420581 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:05:04.420581 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:05:04.420581 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:05:04.420581 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:05:04.420581 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:05:04.420581 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Jul 14 17:05:04.420581 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:05:04.420581 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:05:04.420581 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:05:04.420581 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:05:04.420581 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:05:04.420581 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:05:04.420581 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:05:04.420581 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:05:04.421765 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 17:05:04.421765 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 17:05:04.421765 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:05:04.421765 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Jul 14 17:05:04.423788 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 334/679] 10.222.0.136 () {56 vars in 1113 bytes} [Thu Jul 14 17:05:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 17:05:04.429609 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd24b3c-73d1-4b16-bce2-d12f830accec None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:05:04.429784 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb06fce-be10-4130-bdc4-ab49ebc0e178 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:04.430367 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb06fce-be10-4130-bdc4-ab49ebc0e178 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:04.430846 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb06fce-be10-4130-bdc4-ab49ebc0e178 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:04.432726 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 346/680] 10.222.0.136 () {54 vars in 931 bytes} [Thu Jul 14 17:05:04 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:05:04.438535 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d15b3d-40a3-440d-8562-316e994803c3 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:04.439151 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d15b3d-40a3-440d-8562-316e994803c3 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:04.439665 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d15b3d-40a3-440d-8562-316e994803c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:04.458597 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-c2d15b3d-40a3-440d-8562-316e994803c3 None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:05:04.460174 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-c2d15b3d-40a3-440d-8562-316e994803c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:05:04.494224 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:05:04.543043 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 347/681] 10.222.0.136 () {58 vars in 1028 bytes} [Thu Jul 14 17:05:04 2022] POST /identity/v3/auth/tokens => generated 1000 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 17:05:04.553444 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd24b3c-73d1-4b16-bce2-d12f830accec None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:05:04.567930 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d15b3d-40a3-440d-8562-316e994803c3 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:05:04.591188 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13832d82-a916-46ca-8809-302567bba5f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:05:04.591864 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13832d82-a916-46ca-8809-302567bba5f1 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:04.592148 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13832d82-a916-46ca-8809-302567bba5f1 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:04.592428 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13832d82-a916-46ca-8809-302567bba5f1 None admin] PATH_INFO: `/v3/domains` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:04.593636 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13832d82-a916-46ca-8809-302567bba5f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:05:04.593949 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13832d82-a916-46ca-8809-302567bba5f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:05:04.595762 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13832d82-a916-46ca-8809-302567bba5f1 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:05:04.610155 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 335/682] 10.222.0.136 () {56 vars in 1114 bytes} [Thu Jul 14 17:05:04 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:05:04.615630 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13832d82-a916-46ca-8809-302567bba5f1 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:05:04.634066 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:05:04.693242 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d15b3d-40a3-440d-8562-316e994803c3 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:05:04.730289 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d1655c-d7b4-4e87-8e91-6fc7f9cd384d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:05:04.730959 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d1655c-d7b4-4e87-8e91-6fc7f9cd384d None admin] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:04.731240 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d1655c-d7b4-4e87-8e91-6fc7f9cd384d None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:04.731513 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d1655c-d7b4-4e87-8e91-6fc7f9cd384d None admin] PATH_INFO: `/v3/services` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:04.732230 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d1655c-d7b4-4e87-8e91-6fc7f9cd384d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:05:04.733609 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d1655c-d7b4-4e87-8e91-6fc7f9cd384d None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:05:04.750691 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13832d82-a916-46ca-8809-302567bba5f1 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:05:04.751169 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 348/683] 10.222.0.136 () {60 vars in 1146 bytes} [Thu Jul 14 17:05:04 2022] POST /identity/v3/services => generated 241 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 17:05:04.802018 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d11de1-7422-48a3-92f7-b728d62668eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:05:04.802830 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d11de1-7422-48a3-92f7-b728d62668eb None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:04.803117 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d11de1-7422-48a3-92f7-b728d62668eb None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:04.803397 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d11de1-7422-48a3-92f7-b728d62668eb None admin] PATH_INFO: `/v3/users/nova` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:04.812592 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d11de1-7422-48a3-92f7-b728d62668eb None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:05:04.814174 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d11de1-7422-48a3-92f7-b728d62668eb None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:05:04.829989 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-76d11de1-7422-48a3-92f7-b728d62668eb None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 14 17:05:04.829989 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:05:04.829989 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:05:04.829989 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:05:04.829989 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:05:04.829989 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:05:04.829989 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:05:04.829989 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:05:04.829989 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:05:04.829989 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:05:04.829989 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:05:04.829989 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:05:04.829989 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 17:05:04.829989 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 17:05:04.829989 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 17:05:04.829989 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 17:05:04.831045 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:05:04.831045 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:05:04.831045 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 17:05:04.831045 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 17:05:04.831045 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 17:05:04.831045 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 17:05:04.831045 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:05:04.831045 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:05:04.831045 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:05:04.831045 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:05:04.831045 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:05:04.831045 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Jul 14 17:05:04.831045 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:05:04.831045 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:05:04.831045 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:05:04.831045 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:05:04.831045 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:05:04.831045 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:05:04.833859 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:05:04.833859 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:05:04.833859 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 17:05:04.833859 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 17:05:04.833859 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 17:05:04.833859 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 17:05:04.833859 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 17:05:04.833859 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 17:05:04.833859 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 14 17:05:04.833859 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Jul 14 17:05:04.833859 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 336/684] 10.222.0.136 () {56 vars in 1098 bytes} [Thu Jul 14 17:05:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 17:05:04.837591 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d1655c-d7b4-4e87-8e91-6fc7f9cd384d None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:05:04.873979 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:05:04.960024 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d1655c-d7b4-4e87-8e91-6fc7f9cd384d None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:05:04.997466 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65603d75-d634-4895-9a23-5f7df6456362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:05:04.998410 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65603d75-d634-4895-9a23-5f7df6456362 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:04.998847 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65603d75-d634-4895-9a23-5f7df6456362 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:04.999275 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65603d75-d634-4895-9a23-5f7df6456362 None admin] PATH_INFO: `/v3/users` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:05.000265 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65603d75-d634-4895-9a23-5f7df6456362 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:05:05.000812 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65603d75-d634-4895-9a23-5f7df6456362 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:05:05.002428 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65603d75-d634-4895-9a23-5f7df6456362 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:05:05.022792 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 349/685] 10.222.0.136 () {56 vars in 1138 bytes} [Thu Jul 14 17:05:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:05:05.033625 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d11de1-7422-48a3-92f7-b728d62668eb None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:05:05.105743 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:05:05.139036 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d11de1-7422-48a3-92f7-b728d62668eb None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:05:05.176508 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7d4be2-f515-46d8-b625-e95125f07530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:05:05.180965 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7d4be2-f515-46d8-b625-e95125f07530 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:05.180965 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7d4be2-f515-46d8-b625-e95125f07530 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:05.180965 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7d4be2-f515-46d8-b625-e95125f07530 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:05.192108 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7d4be2-f515-46d8-b625-e95125f07530 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:05:05.193594 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7d4be2-f515-46d8-b625-e95125f07530 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:05:05.212380 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-dc7d4be2-f515-46d8-b625-e95125f07530 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:05:05.212380 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:05:05.212380 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:05:05.212380 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:05:05.212380 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:05:05.212380 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:05:05.212380 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:05:05.212380 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:05:05.212380 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:05:05.212380 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:05:05.212380 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:05:05.212380 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:05:05.212380 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 17:05:05.212380 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 17:05:05.212380 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 17:05:05.213262 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 17:05:05.213262 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:05:05.213262 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:05:05.213262 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:05:05.213262 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:05:05.213262 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:05:05.213262 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:05:05.213262 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:05:05.213262 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Jul 14 17:05:05.213262 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:05:05.213262 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:05:05.213262 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:05:05.213262 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:05:05.213262 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:05:05.213262 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:05:05.213262 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:05:05.213262 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:05:05.215062 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 17:05:05.215062 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 17:05:05.215062 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:05:05.215062 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Jul 14 17:05:05.215062 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 337/686] 10.222.0.136 () {56 vars in 1113 bytes} [Thu Jul 14 17:05:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:05:05.222957 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65603d75-d634-4895-9a23-5f7df6456362 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:05:05.316961 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:05:05.333509 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65603d75-d634-4895-9a23-5f7df6456362 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:05:05.370137 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce013556-bc7d-4f70-b7eb-1f926572b015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:05:05.371177 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce013556-bc7d-4f70-b7eb-1f926572b015 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:05.371666 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce013556-bc7d-4f70-b7eb-1f926572b015 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:05.372174 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce013556-bc7d-4f70-b7eb-1f926572b015 None admin] PATH_INFO: `/v3/domains` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:05.373092 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce013556-bc7d-4f70-b7eb-1f926572b015 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:05:05.373625 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce013556-bc7d-4f70-b7eb-1f926572b015 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:05:05.375207 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce013556-bc7d-4f70-b7eb-1f926572b015 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:05:05.388708 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 350/687] 10.222.0.136 () {56 vars in 1114 bytes} [Thu Jul 14 17:05:05 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:05:05.393922 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7d4be2-f515-46d8-b625-e95125f07530 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:05:05.506481 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7d4be2-f515-46d8-b625-e95125f07530 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:05:05.530155 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:05:05.542209 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dee91f-6b9f-4dda-8d99-d5201fae23ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:05:05.543239 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dee91f-6b9f-4dda-8d99-d5201fae23ec None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:05.543594 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dee91f-6b9f-4dda-8d99-d5201fae23ec None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:05.543879 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dee91f-6b9f-4dda-8d99-d5201fae23ec None admin] PATH_INFO: `/v3/projects/service` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:05.551873 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dee91f-6b9f-4dda-8d99-d5201fae23ec None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:05:05.553349 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dee91f-6b9f-4dda-8d99-d5201fae23ec None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:05:05.568113 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-d7dee91f-6b9f-4dda-8d99-d5201fae23ec None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 17:05:05.568113 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:05:05.568113 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:05:05.568113 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:05:05.568113 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:05:05.568113 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:05:05.568113 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:05:05.568113 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:05:05.568113 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:05:05.568113 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:05:05.568113 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:05:05.568113 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:05:05.568113 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 17:05:05.568113 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 17:05:05.568113 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 17:05:05.569019 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 17:05:05.569019 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:05:05.569019 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:05:05.569019 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:05:05.569019 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:05:05.569019 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:05:05.569019 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:05:05.569019 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:05:05.569019 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Jul 14 17:05:05.569019 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:05:05.569019 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:05:05.569019 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:05:05.569019 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:05:05.569019 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:05:05.569019 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:05:05.569019 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:05:05.569019 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:05:05.570536 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 17:05:05.570536 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 17:05:05.570536 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 17:05:05.570536 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 17:05:05.570536 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 17:05:05.570536 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 17:05:05.570536 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 17:05:05.570536 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Jul 14 17:05:05.570536 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 338/688] 10.222.0.136 () {56 vars in 1116 bytes} [Thu Jul 14 17:05:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:05:05.574940 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce013556-bc7d-4f70-b7eb-1f926572b015 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:05:05.690225 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce013556-bc7d-4f70-b7eb-1f926572b015 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:05:05.726533 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd222f9-6940-4d97-be95-99987aca6549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:05:05.727622 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd222f9-6940-4d97-be95-99987aca6549 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:05.728160 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd222f9-6940-4d97-be95-99987aca6549 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:05.728681 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd222f9-6940-4d97-be95-99987aca6549 None admin] PATH_INFO: `/v3/projects` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:05.729711 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd222f9-6940-4d97-be95-99987aca6549 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:05:05.730492 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd222f9-6940-4d97-be95-99987aca6549 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:05:05.732116 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd222f9-6940-4d97-be95-99987aca6549 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:05:05.745982 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 351/689] 10.222.0.136 () {56 vars in 1153 bytes} [Thu Jul 14 17:05:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:05:05.757566 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dee91f-6b9f-4dda-8d99-d5201fae23ec None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:05:05.786912 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a75e8a7-ab3a-4b5a-be1c-8f2e6af89af1 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:05.787205 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a75e8a7-ab3a-4b5a-be1c-8f2e6af89af1 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:05.787470 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a75e8a7-ab3a-4b5a-be1c-8f2e6af89af1 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:05.789074 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 352/690] 10.222.0.136 () {54 vars in 931 bytes} [Thu Jul 14 17:05:05 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 14 17:05:05.793900 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a9d2c1-b14a-48f8-8ccf-24e56bc8e5f1 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:05.794187 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a9d2c1-b14a-48f8-8ccf-24e56bc8e5f1 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:05.794465 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a9d2c1-b14a-48f8-8ccf-24e56bc8e5f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:05.805702 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:05:05.811869 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-71a9d2c1-b14a-48f8-8ccf-24e56bc8e5f1 None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:05:05.815007 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-71a9d2c1-b14a-48f8-8ccf-24e56bc8e5f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:05:05.867168 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dee91f-6b9f-4dda-8d99-d5201fae23ec None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:05:05.911996 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 353/691] 10.222.0.136 () {58 vars in 1028 bytes} [Thu Jul 14 17:05:05 2022] POST /identity/v3/auth/tokens => generated 1099 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 17:05:05.915194 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c65575d-648e-4413-9a67-09f7700eda84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:05:05.916316 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c65575d-648e-4413-9a67-09f7700eda84 None admin] REQUEST_METHOD: `PUT` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:05.916771 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c65575d-648e-4413-9a67-09f7700eda84 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:05.917213 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c65575d-648e-4413-9a67-09f7700eda84 None admin] PATH_INFO: `/v3/projects/d57eaa6dbca24cbb99dce1fe3437ecae/users/bc2b7d015c2046ddacac6e682f22d0f5/roles/284c6314b4d3492085e397a87b0e3b51` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:05.919360 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c65575d-648e-4413-9a67-09f7700eda84 None admin] RBAC: Authorizing `identity:create_grant(project_id=d57eaa6dbca24cbb99dce1fe3437ecae, user_id=bc2b7d015c2046ddacac6e682f22d0f5, role_id=284c6314b4d3492085e397a87b0e3b51)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:05:05.920953 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c65575d-648e-4413-9a67-09f7700eda84 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:05:05.934081 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a9d2c1-b14a-48f8-8ccf-24e56bc8e5f1 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:05:05.939662 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 339/692] 10.222.0.136 () {58 vars in 1444 bytes} [Thu Jul 14 17:05:05 2022] PUT /identity/v3/projects/d57eaa6dbca24cbb99dce1fe3437ecae/users/bc2b7d015c2046ddacac6e682f22d0f5/roles/284c6314b4d3492085e397a87b0e3b51 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:05:06.069008 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a9d2c1-b14a-48f8-8ccf-24e56bc8e5f1 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:05:06.110387 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366be50d-cd9a-4547-8a96-25e43a0c12df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:05:06.111482 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366be50d-cd9a-4547-8a96-25e43a0c12df None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:06.111935 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366be50d-cd9a-4547-8a96-25e43a0c12df None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:06.112370 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366be50d-cd9a-4547-8a96-25e43a0c12df None admin] PATH_INFO: `/v3/services/image` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:06.113430 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366be50d-cd9a-4547-8a96-25e43a0c12df None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:05:06.115057 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366be50d-cd9a-4547-8a96-25e43a0c12df None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:05:06.118549 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:05:06.129661 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-366be50d-cd9a-4547-8a96-25e43a0c12df None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 14 17:05:06.129661 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:05:06.129661 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 17:05:06.129661 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 17:05:06.129661 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 17:05:06.129661 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 17:05:06.129661 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 17:05:06.129661 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 17:05:06.129661 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 14 17:05:06.129661 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Jul 14 17:05:06.129661 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 17:05:06.129661 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Jul 14 17:05:06.129661 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:05:06.129661 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:05:06.129661 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:05:06.129661 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:05:06.129661 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:05:06.130989 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:05:06.130989 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:05:06.130989 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:05:06.130989 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:05:06.130989 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:05:06.130989 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:05:06.130989 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 17:05:06.130989 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 17:05:06.130989 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 17:05:06.130989 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 17:05:06.130989 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:05:06.130989 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:05:06.130989 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:05:06.130989 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:05:06.130989 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:05:06.130989 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:05:06.132008 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:05:06.132008 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Jul 14 17:05:06.132008 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:05:06.132008 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:05:06.132008 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:05:06.132008 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:05:06.132008 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:05:06.132008 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:05:06.132008 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:05:06.132008 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:05:06.132008 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 17:05:06.132008 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 17:05:06.132008 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 14 17:05:06.132008 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Jul 14 17:05:06.134586 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 354/693] 10.222.0.136 () {56 vars in 1110 bytes} [Thu Jul 14 17:05:05 2022] GET /identity/v3/services/image => generated 86 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 17:05:06.142678 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c65575d-648e-4413-9a67-09f7700eda84 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:05:06.206923 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:05:06.266716 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c65575d-648e-4413-9a67-09f7700eda84 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:05:06.304335 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedc5634-c7e9-472c-b168-a4afcdfb46cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:05:06.305021 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedc5634-c7e9-472c-b168-a4afcdfb46cc None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:06.305310 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedc5634-c7e9-472c-b168-a4afcdfb46cc None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:06.305611 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedc5634-c7e9-472c-b168-a4afcdfb46cc None admin] PATH_INFO: `/v3/services` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:06.306320 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedc5634-c7e9-472c-b168-a4afcdfb46cc None admin] RBAC: Adding query filter params (name=image) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:05:06.306630 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedc5634-c7e9-472c-b168-a4afcdfb46cc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:05:06.308079 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedc5634-c7e9-472c-b168-a4afcdfb46cc None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:05:06.313190 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 340/694] 10.222.0.136 () {56 vars in 1113 bytes} [Thu Jul 14 17:05:06 2022] GET /identity/v3/services?name=image => generated 123 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:05:06.319541 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366be50d-cd9a-4547-8a96-25e43a0c12df None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:05:06.425977 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366be50d-cd9a-4547-8a96-25e43a0c12df None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:05:06.461463 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46e2c93-5f5e-45ff-848d-1febfdb3f2e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:05:06.462503 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46e2c93-5f5e-45ff-848d-1febfdb3f2e3 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:06.462990 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46e2c93-5f5e-45ff-848d-1febfdb3f2e3 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:06.463466 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46e2c93-5f5e-45ff-848d-1febfdb3f2e3 None admin] PATH_INFO: `/v3/services` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:06.464407 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46e2c93-5f5e-45ff-848d-1febfdb3f2e3 None admin] RBAC: Adding query filter params (type=image) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:05:06.464911 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46e2c93-5f5e-45ff-848d-1febfdb3f2e3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:05:06.466488 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46e2c93-5f5e-45ff-848d-1febfdb3f2e3 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:05:06.473941 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 355/695] 10.222.0.136 () {56 vars in 1113 bytes} [Thu Jul 14 17:05:06 2022] GET /identity/v3/services?type=image => generated 352 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:05:06.480201 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedc5634-c7e9-472c-b168-a4afcdfb46cc None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:05:06.587802 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedc5634-c7e9-472c-b168-a4afcdfb46cc None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:05:06.595441 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:05:06.624576 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dc9340-4e96-482b-93f8-a253ca059f74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:05:06.625250 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dc9340-4e96-482b-93f8-a253ca059f74 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:06.625538 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dc9340-4e96-482b-93f8-a253ca059f74 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:06.625841 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dc9340-4e96-482b-93f8-a253ca059f74 None admin] PATH_INFO: `/v3/endpoints` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:06.626632 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dc9340-4e96-482b-93f8-a253ca059f74 None admin] RBAC: Adding query filter params (interface=public, service_id=6167e52a85e449bba13c9f62c17454a1, region_id=RegionOne) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:05:06.626947 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dc9340-4e96-482b-93f8-a253ca059f74 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:05:06.628969 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dc9340-4e96-482b-93f8-a253ca059f74 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:05:06.637296 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 341/696] 10.222.0.136 () {56 vars in 1256 bytes} [Thu Jul 14 17:05:06 2022] GET /identity/v3/endpoints?service_id=6167e52a85e449bba13c9f62c17454a1&interface=public®ion_id=RegionOne => generated 195 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:05:06.642692 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46e2c93-5f5e-45ff-848d-1febfdb3f2e3 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:05:06.713050 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:05:06.754016 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46e2c93-5f5e-45ff-848d-1febfdb3f2e3 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:05:06.791503 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3010dec-3218-4702-a8b7-a197209f4ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:05:06.792176 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3010dec-3218-4702-a8b7-a197209f4ace None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:06.792477 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3010dec-3218-4702-a8b7-a197209f4ace None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:06.792739 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3010dec-3218-4702-a8b7-a197209f4ace None admin] PATH_INFO: `/v3/services` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:06.793430 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3010dec-3218-4702-a8b7-a197209f4ace None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:05:06.794818 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3010dec-3218-4702-a8b7-a197209f4ace None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:05:06.801153 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 356/697] 10.222.0.136 () {56 vars in 1092 bytes} [Thu Jul 14 17:05:06 2022] GET /identity/v3/services => generated 1007 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 17:05:06.841350 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b39ca88-4944-40b7-a1e2-4ca19d56b179 None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:06.841764 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b39ca88-4944-40b7-a1e2-4ca19d56b179 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:06.841997 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b39ca88-4944-40b7-a1e2-4ca19d56b179 None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:06.843452 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 342/698] 10.222.0.136 () {54 vars in 931 bytes} [Thu Jul 14 17:05:06 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:05:06.852632 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a69476-4a06-462f-92f4-4c2751441227 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:06.853159 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a69476-4a06-462f-92f4-4c2751441227 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:06.853706 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a69476-4a06-462f-92f4-4c2751441227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:06.876045 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-e6a69476-4a06-462f-92f4-4c2751441227 None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:05:06.877263 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-e6a69476-4a06-462f-92f4-4c2751441227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:05:06.957016 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 357/699] 10.222.0.136 () {58 vars in 1028 bytes} [Thu Jul 14 17:05:06 2022] POST /identity/v3/auth/tokens => generated 1099 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 17:05:06.986418 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b39ca88-4944-40b7-a1e2-4ca19d56b179 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:05:07.124061 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b39ca88-4944-40b7-a1e2-4ca19d56b179 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:05:07.169421 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96de9188-9aae-4ecc-956c-8b4e06917943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:05:07.170290 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96de9188-9aae-4ecc-956c-8b4e06917943 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:07.170576 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96de9188-9aae-4ecc-956c-8b4e06917943 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:07.170855 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96de9188-9aae-4ecc-956c-8b4e06917943 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:07.171682 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96de9188-9aae-4ecc-956c-8b4e06917943 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:05:07.172998 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96de9188-9aae-4ecc-956c-8b4e06917943 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:05:07.187603 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-96de9188-9aae-4ecc-956c-8b4e06917943 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 14 17:05:07.187603 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:05:07.187603 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 17:05:07.187603 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 17:05:07.187603 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 17:05:07.187603 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 17:05:07.187603 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 17:05:07.187603 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 17:05:07.187603 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 14 17:05:07.187603 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Jul 14 17:05:07.187603 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 17:05:07.187603 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Jul 14 17:05:07.187603 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:05:07.187603 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:05:07.187603 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:05:07.187603 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:05:07.188622 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:05:07.188622 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:05:07.188622 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:05:07.188622 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:05:07.188622 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:05:07.188622 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:05:07.188622 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:05:07.188622 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 17:05:07.188622 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 17:05:07.188622 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 17:05:07.188622 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 17:05:07.188622 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:05:07.188622 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:05:07.188622 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:05:07.188622 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:05:07.188622 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:05:07.190509 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:05:07.190509 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:05:07.190509 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Jul 14 17:05:07.190509 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:05:07.190509 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:05:07.190509 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:05:07.190509 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:05:07.190509 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:05:07.190509 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:05:07.190509 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:05:07.190509 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:05:07.190509 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 17:05:07.190509 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 17:05:07.190509 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 14 17:05:07.190509 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Jul 14 17:05:07.190509 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 343/700] 10.222.0.136 () {56 vars in 1134 bytes} [Thu Jul 14 17:05:06 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 17:05:07.198725 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a69476-4a06-462f-92f4-4c2751441227 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:05:07.280718 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:05:07.338161 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a69476-4a06-462f-92f4-4c2751441227 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:05:07.358213 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c9b42d-b7b4-4968-b3ab-5b4f3b4fbcb3 None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:07.358866 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c9b42d-b7b4-4968-b3ab-5b4f3b4fbcb3 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:07.359347 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c9b42d-b7b4-4968-b3ab-5b4f3b4fbcb3 None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:07.361751 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 344/701] 10.222.0.136 () {54 vars in 931 bytes} [Thu Jul 14 17:05:07 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:05:07.368413 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b667734-fa47-4d11-b347-fef11286a6e5 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:07.369016 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b667734-fa47-4d11-b347-fef11286a6e5 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:07.369508 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b667734-fa47-4d11-b347-fef11286a6e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:07.386692 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adae5c8-d87c-48d8-a56d-e329f91c8f49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:05:07.387369 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adae5c8-d87c-48d8-a56d-e329f91c8f49 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:07.387656 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adae5c8-d87c-48d8-a56d-e329f91c8f49 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:07.387935 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adae5c8-d87c-48d8-a56d-e329f91c8f49 None admin] PATH_INFO: `/v3/services` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:07.388653 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adae5c8-d87c-48d8-a56d-e329f91c8f49 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:05:07.388973 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adae5c8-d87c-48d8-a56d-e329f91c8f49 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:05:07.391183 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-4b667734-fa47-4d11-b347-fef11286a6e5 None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:05:07.392469 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adae5c8-d87c-48d8-a56d-e329f91c8f49 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:05:07.393200 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-4b667734-fa47-4d11-b347-fef11286a6e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:05:07.400170 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 358/702] 10.222.0.136 () {56 vars in 1129 bytes} [Thu Jul 14 17:05:07 2022] GET /identity/v3/services?name=block-storage => generated 131 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:05:07.405659 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adae5c8-d87c-48d8-a56d-e329f91c8f49 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:05:07.431209 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:05:07.482487 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 345/703] 10.222.0.136 () {58 vars in 1028 bytes} [Thu Jul 14 17:05:07 2022] POST /identity/v3/auth/tokens => generated 1099 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 17:05:07.511083 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b667734-fa47-4d11-b347-fef11286a6e5 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:05:07.540365 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adae5c8-d87c-48d8-a56d-e329f91c8f49 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:05:07.570555 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:05:07.587825 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77725c87-f0b0-49d5-9755-a98068948039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:05:07.588994 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77725c87-f0b0-49d5-9755-a98068948039 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:07.589883 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77725c87-f0b0-49d5-9755-a98068948039 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:07.590404 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77725c87-f0b0-49d5-9755-a98068948039 None admin] PATH_INFO: `/v3/services` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:07.591929 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77725c87-f0b0-49d5-9755-a98068948039 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:05:07.592722 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77725c87-f0b0-49d5-9755-a98068948039 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:05:07.595406 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77725c87-f0b0-49d5-9755-a98068948039 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:05:07.603092 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 359/704] 10.222.0.136 () {56 vars in 1129 bytes} [Thu Jul 14 17:05:07 2022] GET /identity/v3/services?type=block-storage => generated 369 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 17:05:07.610535 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77725c87-f0b0-49d5-9755-a98068948039 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:05:07.683297 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b667734-fa47-4d11-b347-fef11286a6e5 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:05:07.740743 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9861e6a-8861-4e68-a3ec-d57639d26594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:05:07.743139 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9861e6a-8861-4e68-a3ec-d57639d26594 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:07.744240 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9861e6a-8861-4e68-a3ec-d57639d26594 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:07.744976 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9861e6a-8861-4e68-a3ec-d57639d26594 None admin] PATH_INFO: `/v3/services/network` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:07.747675 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9861e6a-8861-4e68-a3ec-d57639d26594 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:05:07.749773 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9861e6a-8861-4e68-a3ec-d57639d26594 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:05:07.758061 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77725c87-f0b0-49d5-9755-a98068948039 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:05:07.766300 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-c9861e6a-8861-4e68-a3ec-d57639d26594 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 14 17:05:07.766300 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:05:07.766300 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 17:05:07.766300 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 17:05:07.766300 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 17:05:07.766300 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 17:05:07.766300 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 17:05:07.766300 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 17:05:07.766300 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 14 17:05:07.766300 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Jul 14 17:05:07.766300 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 17:05:07.766300 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Jul 14 17:05:07.766300 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:05:07.766300 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:05:07.766300 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:05:07.766300 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:05:07.766300 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:05:07.767395 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:05:07.767395 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:05:07.767395 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:05:07.767395 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:05:07.767395 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:05:07.767395 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:05:07.767395 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 17:05:07.767395 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 17:05:07.767395 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 17:05:07.767395 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 17:05:07.767395 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:05:07.767395 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:05:07.767395 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:05:07.767395 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:05:07.767395 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:05:07.767395 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:05:07.768312 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:05:07.768312 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Jul 14 17:05:07.768312 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:05:07.768312 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:05:07.768312 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:05:07.768312 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:05:07.768312 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:05:07.768312 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:05:07.768312 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:05:07.768312 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:05:07.768312 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 17:05:07.768312 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 17:05:07.768312 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 14 17:05:07.768312 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Jul 14 17:05:07.776229 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 346/705] 10.222.0.136 () {56 vars in 1116 bytes} [Thu Jul 14 17:05:07 2022] GET /identity/v3/services/network => generated 88 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:05:07.777467 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9861e6a-8861-4e68-a3ec-d57639d26594 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:05:07.821804 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efcf734-b3e7-4dee-b518-5e03411b5067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:05:07.823468 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efcf734-b3e7-4dee-b518-5e03411b5067 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:07.824064 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efcf734-b3e7-4dee-b518-5e03411b5067 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:07.825523 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efcf734-b3e7-4dee-b518-5e03411b5067 None admin] PATH_INFO: `/v3/endpoints` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:07.826513 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efcf734-b3e7-4dee-b518-5e03411b5067 None admin] RBAC: Adding query filter params (interface=public, service_id=be4fa3f056c34128a323bdd0608258fa, region_id=RegionOne) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:05:07.827752 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efcf734-b3e7-4dee-b518-5e03411b5067 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:05:07.828905 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:05:07.829792 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efcf734-b3e7-4dee-b518-5e03411b5067 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:05:07.857607 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 360/706] 10.222.0.136 () {56 vars in 1256 bytes} [Thu Jul 14 17:05:07 2022] GET /identity/v3/endpoints?service_id=be4fa3f056c34128a323bdd0608258fa&interface=public®ion_id=RegionOne => generated 195 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:05:07.866015 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efcf734-b3e7-4dee-b518-5e03411b5067 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:05:07.929936 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:05:07.931190 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9861e6a-8861-4e68-a3ec-d57639d26594 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:05:07.969076 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0032f6-81ca-40d8-b909-6545f11ddaa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:05:07.970035 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0032f6-81ca-40d8-b909-6545f11ddaa5 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:07.970472 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0032f6-81ca-40d8-b909-6545f11ddaa5 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:07.970902 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0032f6-81ca-40d8-b909-6545f11ddaa5 None admin] PATH_INFO: `/v3/services` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:07.971786 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0032f6-81ca-40d8-b909-6545f11ddaa5 None admin] RBAC: Adding query filter params (name=network) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:05:07.972875 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0032f6-81ca-40d8-b909-6545f11ddaa5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:05:07.974574 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0032f6-81ca-40d8-b909-6545f11ddaa5 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:05:07.984904 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 347/707] 10.222.0.136 () {56 vars in 1117 bytes} [Thu Jul 14 17:05:07 2022] GET /identity/v3/services?name=network => generated 125 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:05:07.986413 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0032f6-81ca-40d8-b909-6545f11ddaa5 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:05:08.005032 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efcf734-b3e7-4dee-b518-5e03411b5067 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:05:08.046560 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3685905-cfa2-4211-a235-413f427244b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:05:08.047267 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3685905-cfa2-4211-a235-413f427244b9 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:08.047941 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3685905-cfa2-4211-a235-413f427244b9 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:08.048051 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3685905-cfa2-4211-a235-413f427244b9 None admin] PATH_INFO: `/v3/services` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:08.048926 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3685905-cfa2-4211-a235-413f427244b9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:05:08.051039 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3685905-cfa2-4211-a235-413f427244b9 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:05:08.065665 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 361/708] 10.222.0.136 () {56 vars in 1092 bytes} [Thu Jul 14 17:05:07 2022] GET /identity/v3/services => generated 1007 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 17:05:08.095871 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:05:08.108530 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0032f6-81ca-40d8-b909-6545f11ddaa5 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:05:08.149904 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20c2d2c-b1dd-4d02-a369-75f75bc0b366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:05:08.150999 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20c2d2c-b1dd-4d02-a369-75f75bc0b366 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:08.151497 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20c2d2c-b1dd-4d02-a369-75f75bc0b366 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:08.151985 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20c2d2c-b1dd-4d02-a369-75f75bc0b366 None admin] PATH_INFO: `/v3/services` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:08.152937 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20c2d2c-b1dd-4d02-a369-75f75bc0b366 None admin] RBAC: Adding query filter params (type=network) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:05:08.153575 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20c2d2c-b1dd-4d02-a369-75f75bc0b366 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:05:08.155191 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20c2d2c-b1dd-4d02-a369-75f75bc0b366 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:05:08.165964 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 348/709] 10.222.0.136 () {56 vars in 1117 bytes} [Thu Jul 14 17:05:07 2022] GET /identity/v3/services?type=network => generated 352 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 17:05:08.169180 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3685905-cfa2-4211-a235-413f427244b9 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:05:08.312091 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3685905-cfa2-4211-a235-413f427244b9 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:05:08.333682 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:05:08.360692 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4d5a7f-1f67-4450-98c6-57a58ef105ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:05:08.361313 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4d5a7f-1f67-4450-98c6-57a58ef105ee None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:08.361573 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4d5a7f-1f67-4450-98c6-57a58ef105ee None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:08.361877 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4d5a7f-1f67-4450-98c6-57a58ef105ee None admin] PATH_INFO: `/v3/endpoints` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:08.363312 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4d5a7f-1f67-4450-98c6-57a58ef105ee None admin] RBAC: Adding query filter params (interface=public, service_id=9933546b2e3144b8bffc24bcbb5054f3, region_id=RegionOne) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:05:08.363833 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4d5a7f-1f67-4450-98c6-57a58ef105ee None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:05:08.365938 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4d5a7f-1f67-4450-98c6-57a58ef105ee None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:05:08.371841 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 362/710] 10.222.0.136 () {56 vars in 1256 bytes} [Thu Jul 14 17:05:08 2022] GET /identity/v3/endpoints?service_id=9933546b2e3144b8bffc24bcbb5054f3&interface=public®ion_id=RegionOne => generated 195 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:05:08.377056 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20c2d2c-b1dd-4d02-a369-75f75bc0b366 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:05:08.482886 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20c2d2c-b1dd-4d02-a369-75f75bc0b366 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:05:08.485789 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9a3bdc-d59b-4d40-b441-4dea0d19fd2a None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:08.486091 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9a3bdc-d59b-4d40-b441-4dea0d19fd2a None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:08.486375 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9a3bdc-d59b-4d40-b441-4dea0d19fd2a None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:08.488644 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 363/711] 10.222.0.136 () {54 vars in 931 bytes} [Thu Jul 14 17:05:08 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:05:08.493669 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c463ea58-d255-4117-b931-0c8ca743a90f None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:08.494210 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c463ea58-d255-4117-b931-0c8ca743a90f None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:08.494696 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c463ea58-d255-4117-b931-0c8ca743a90f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:08.512278 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-c463ea58-d255-4117-b931-0c8ca743a90f None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:05:08.513814 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-c463ea58-d255-4117-b931-0c8ca743a90f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:05:08.519775 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64d10fb-53d6-4a91-8d06-2b759d9b3c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:05:08.520455 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64d10fb-53d6-4a91-8d06-2b759d9b3c7c None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:08.520744 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64d10fb-53d6-4a91-8d06-2b759d9b3c7c None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:08.521028 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64d10fb-53d6-4a91-8d06-2b759d9b3c7c None admin] PATH_INFO: `/v3/services` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:08.521751 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64d10fb-53d6-4a91-8d06-2b759d9b3c7c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:05:08.523125 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64d10fb-53d6-4a91-8d06-2b759d9b3c7c None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:05:08.537665 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 349/712] 10.222.0.136 () {56 vars in 1092 bytes} [Thu Jul 14 17:05:08 2022] GET /identity/v3/services => generated 1007 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 17:05:08.591523 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 364/713] 10.222.0.136 () {58 vars in 1028 bytes} [Thu Jul 14 17:05:08 2022] POST /identity/v3/auth/tokens => generated 1099 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 17:05:08.619243 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64d10fb-53d6-4a91-8d06-2b759d9b3c7c None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:05:08.644978 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:05:08.743914 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64d10fb-53d6-4a91-8d06-2b759d9b3c7c None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:05:08.782876 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6efbec-2705-4a60-aa00-02c222571fd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:05:08.783726 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6efbec-2705-4a60-aa00-02c222571fd2 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:08.784019 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6efbec-2705-4a60-aa00-02c222571fd2 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:08.784300 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6efbec-2705-4a60-aa00-02c222571fd2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:08.795941 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6efbec-2705-4a60-aa00-02c222571fd2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 17:05:08.803883 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-da6efbec-2705-4a60-aa00-02c222571fd2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 17:05:08.803883 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:05:08.803883 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:05:08.803883 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:05:08.803883 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:05:08.803883 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:05:08.803883 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:05:08.803883 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:05:08.803883 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:05:08.803883 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:05:08.803883 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:05:08.803883 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:05:08.803883 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 17:05:08.803883 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 17:05:08.803883 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 17:05:08.803883 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 17:05:08.804830 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 17:05:08.804830 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 17:05:08.804830 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 17:05:08.804830 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 17:05:08.804830 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:05:08.804830 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:05:08.804830 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:05:08.804830 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:05:08.804830 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:05:08.804830 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:05:08.804830 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:05:08.804830 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Jul 14 17:05:08.804830 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:05:08.804830 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:05:08.804830 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:05:08.804830 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:05:08.805724 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:05:08.805724 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:05:08.805724 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:05:08.805724 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:05:08.805724 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 17:05:08.805724 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 17:05:08.805724 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 17:05:08.805724 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 17:05:08.805724 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 17:05:08.805724 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 17:05:08.805724 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 17:05:08.805724 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Jul 14 17:05:08.805724 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 350/714] 10.222.0.136 () {56 vars in 1101 bytes} [Thu Jul 14 17:05:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:05:08.811503 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c463ea58-d255-4117-b931-0c8ca743a90f None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:05:08.921046 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c463ea58-d255-4117-b931-0c8ca743a90f None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:05:08.931911 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:05:08.959706 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a060c4b-e05f-4150-be46-b6e2979b76f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:05:08.960378 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a060c4b-e05f-4150-be46-b6e2979b76f6 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:08.960667 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a060c4b-e05f-4150-be46-b6e2979b76f6 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:08.960942 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a060c4b-e05f-4150-be46-b6e2979b76f6 None admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:08.961724 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a060c4b-e05f-4150-be46-b6e2979b76f6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:05:08.962033 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a060c4b-e05f-4150-be46-b6e2979b76f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:05:08.963386 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a060c4b-e05f-4150-be46-b6e2979b76f6 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:05:08.973284 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 365/715] 10.222.0.136 () {56 vars in 1104 bytes} [Thu Jul 14 17:05:08 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:05:08.982993 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6efbec-2705-4a60-aa00-02c222571fd2 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:05:09.076420 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:05:09.099150 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6efbec-2705-4a60-aa00-02c222571fd2 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:05:09.137446 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd126a8-22b1-4482-9ab3-0b0746925930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:05:09.138645 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd126a8-22b1-4482-9ab3-0b0746925930 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:09.139141 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd126a8-22b1-4482-9ab3-0b0746925930 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:09.139651 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd126a8-22b1-4482-9ab3-0b0746925930 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:09.151858 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd126a8-22b1-4482-9ab3-0b0746925930 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:05:09.153624 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd126a8-22b1-4482-9ab3-0b0746925930 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:05:09.172302 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-edd126a8-22b1-4482-9ab3-0b0746925930 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:05:09.172302 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:05:09.172302 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:05:09.172302 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:05:09.172302 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:05:09.172302 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:05:09.172302 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:05:09.172302 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:05:09.172302 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:05:09.172302 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:05:09.172302 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:05:09.172302 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:05:09.172302 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 17:05:09.172302 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 17:05:09.172302 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 17:05:09.173232 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 17:05:09.173232 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:05:09.173232 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:05:09.173232 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:05:09.173232 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:05:09.173232 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:05:09.173232 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:05:09.173232 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:05:09.173232 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Jul 14 17:05:09.173232 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:05:09.173232 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:05:09.173232 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:05:09.173232 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:05:09.173232 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:05:09.173232 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:05:09.173232 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:05:09.173232 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:05:09.174170 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 17:05:09.174170 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 17:05:09.174170 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:05:09.174170 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Jul 14 17:05:09.177481 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 351/716] 10.222.0.136 () {56 vars in 1113 bytes} [Thu Jul 14 17:05:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:05:09.185714 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a060c4b-e05f-4150-be46-b6e2979b76f6 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:05:09.305537 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a060c4b-e05f-4150-be46-b6e2979b76f6 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:05:09.342380 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c6f2c5-2b05-4a37-9605-15917bf6738b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:05:09.343563 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c6f2c5-2b05-4a37-9605-15917bf6738b None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:09.343851 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c6f2c5-2b05-4a37-9605-15917bf6738b None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:09.344128 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c6f2c5-2b05-4a37-9605-15917bf6738b None admin] PATH_INFO: `/v3/domains` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:09.344857 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c6f2c5-2b05-4a37-9605-15917bf6738b None admin] RBAC: Adding query filter params (name=Default) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:05:09.345168 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c6f2c5-2b05-4a37-9605-15917bf6738b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:05:09.347367 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c6f2c5-2b05-4a37-9605-15917bf6738b None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:05:09.361985 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 366/717] 10.222.0.136 () {56 vars in 1114 bytes} [Thu Jul 14 17:05:09 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:05:09.363817 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c3d9fd-be6e-43c3-b433-2add0e932b65 None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:09.364212 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c3d9fd-be6e-43c3-b433-2add0e932b65 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:09.364503 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c3d9fd-be6e-43c3-b433-2add0e932b65 None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:09.368125 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 352/718] 10.222.0.136 () {54 vars in 931 bytes} [Thu Jul 14 17:05:09 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 14 17:05:09.369226 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c6f2c5-2b05-4a37-9605-15917bf6738b None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:05:09.371862 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a56e6f-e5d0-4b22-9357-ad0860b73aed None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:09.372488 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a56e6f-e5d0-4b22-9357-ad0860b73aed None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:09.372974 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a56e6f-e5d0-4b22-9357-ad0860b73aed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:09.391981 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-f7a56e6f-e5d0-4b22-9357-ad0860b73aed None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:05:09.394254 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-f7a56e6f-e5d0-4b22-9357-ad0860b73aed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:05:09.405014 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:05:09.485027 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c6f2c5-2b05-4a37-9605-15917bf6738b None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:05:09.493586 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 353/719] 10.222.0.136 () {58 vars in 1028 bytes} [Thu Jul 14 17:05:09 2022] POST /identity/v3/auth/tokens => generated 1099 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 17:05:09.518217 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a56e6f-e5d0-4b22-9357-ad0860b73aed None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:05:09.530078 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f55eb06-ed20-425f-8d66-da34c82f039a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:05:09.530868 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f55eb06-ed20-425f-8d66-da34c82f039a None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:09.531159 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f55eb06-ed20-425f-8d66-da34c82f039a None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:09.531434 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f55eb06-ed20-425f-8d66-da34c82f039a None admin] PATH_INFO: `/v3/users/nova` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:09.540210 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f55eb06-ed20-425f-8d66-da34c82f039a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:05:09.541678 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f55eb06-ed20-425f-8d66-da34c82f039a None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:05:09.556647 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-8f55eb06-ed20-425f-8d66-da34c82f039a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 14 17:05:09.556647 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:05:09.556647 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:05:09.556647 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:05:09.556647 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:05:09.556647 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:05:09.556647 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:05:09.556647 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:05:09.556647 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:05:09.556647 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:05:09.556647 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:05:09.556647 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:05:09.556647 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 17:05:09.556647 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 17:05:09.556647 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 17:05:09.556647 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 17:05:09.557660 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:05:09.557660 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:05:09.557660 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 17:05:09.557660 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 17:05:09.557660 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 17:05:09.557660 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 17:05:09.557660 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:05:09.557660 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:05:09.557660 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:05:09.557660 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:05:09.557660 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:05:09.557660 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Jul 14 17:05:09.557660 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:05:09.557660 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:05:09.557660 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:05:09.557660 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:05:09.557660 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:05:09.557660 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:05:09.558644 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:05:09.558644 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:05:09.558644 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 17:05:09.558644 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 17:05:09.558644 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 17:05:09.558644 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 17:05:09.558644 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 17:05:09.558644 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 17:05:09.558644 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 14 17:05:09.558644 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Jul 14 17:05:09.567169 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 367/720] 10.222.0.136 () {56 vars in 1098 bytes} [Thu Jul 14 17:05:09 2022] GET /identity/v3/users/nova => generated 82 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:05:09.568648 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f55eb06-ed20-425f-8d66-da34c82f039a None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:05:09.588500 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:05:09.637744 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a56e6f-e5d0-4b22-9357-ad0860b73aed None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:05:09.680895 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:05:09.681105 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc41b82-6d0f-4492-8cab-20ae7820759d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:05:09.682130 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc41b82-6d0f-4492-8cab-20ae7820759d None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:09.683042 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc41b82-6d0f-4492-8cab-20ae7820759d None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:09.683682 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc41b82-6d0f-4492-8cab-20ae7820759d None admin] PATH_INFO: `/v3/services/image` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:09.684647 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc41b82-6d0f-4492-8cab-20ae7820759d None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:05:09.687397 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc41b82-6d0f-4492-8cab-20ae7820759d None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:05:09.694308 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f55eb06-ed20-425f-8d66-da34c82f039a None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:05:09.709641 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-9bc41b82-6d0f-4492-8cab-20ae7820759d None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 14 17:05:09.709641 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:05:09.709641 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 17:05:09.709641 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 17:05:09.709641 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 17:05:09.709641 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 17:05:09.709641 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 17:05:09.709641 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 17:05:09.709641 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 14 17:05:09.709641 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Jul 14 17:05:09.709641 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 17:05:09.709641 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Jul 14 17:05:09.709641 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:05:09.709641 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:05:09.709641 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:05:09.709641 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:05:09.709641 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:05:09.710936 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:05:09.710936 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:05:09.710936 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:05:09.710936 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:05:09.710936 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:05:09.710936 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:05:09.710936 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 17:05:09.710936 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 17:05:09.710936 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 17:05:09.710936 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 17:05:09.710936 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:05:09.710936 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:05:09.710936 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:05:09.710936 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:05:09.710936 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:05:09.710936 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:05:09.711921 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:05:09.711921 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Jul 14 17:05:09.711921 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:05:09.711921 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:05:09.711921 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:05:09.711921 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:05:09.711921 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:05:09.711921 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:05:09.711921 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:05:09.711921 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:05:09.711921 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 17:05:09.711921 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 17:05:09.711921 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 14 17:05:09.711921 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Jul 14 17:05:09.715021 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 354/721] 10.222.0.136 () {56 vars in 1110 bytes} [Thu Jul 14 17:05:09 2022] GET /identity/v3/services/image => generated 86 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 17:05:09.721959 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc41b82-6d0f-4492-8cab-20ae7820759d None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:05:09.739566 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09155467-e707-4868-ad60-858ad0a21f6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:05:09.740565 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09155467-e707-4868-ad60-858ad0a21f6d None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:09.741058 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09155467-e707-4868-ad60-858ad0a21f6d None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:09.741537 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09155467-e707-4868-ad60-858ad0a21f6d None admin] PATH_INFO: `/v3/users` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:09.742642 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09155467-e707-4868-ad60-858ad0a21f6d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:05:09.743157 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09155467-e707-4868-ad60-858ad0a21f6d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:05:09.744779 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09155467-e707-4868-ad60-858ad0a21f6d None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:05:09.771140 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 368/722] 10.222.0.136 () {56 vars in 1138 bytes} [Thu Jul 14 17:05:09 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:05:09.772778 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09155467-e707-4868-ad60-858ad0a21f6d None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:05:09.851448 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc41b82-6d0f-4492-8cab-20ae7820759d None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:05:09.881558 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:05:09.888569 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09155467-e707-4868-ad60-858ad0a21f6d None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:05:09.890891 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66f307e-96b7-46f9-a8a8-6c63b0df0294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:05:09.891694 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66f307e-96b7-46f9-a8a8-6c63b0df0294 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:09.891985 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66f307e-96b7-46f9-a8a8-6c63b0df0294 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:09.892266 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66f307e-96b7-46f9-a8a8-6c63b0df0294 None admin] PATH_INFO: `/v3/services` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:09.892976 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66f307e-96b7-46f9-a8a8-6c63b0df0294 None admin] RBAC: Adding query filter params (name=image) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:05:09.893287 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66f307e-96b7-46f9-a8a8-6c63b0df0294 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:05:09.895926 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66f307e-96b7-46f9-a8a8-6c63b0df0294 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:05:09.905611 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 355/723] 10.222.0.136 () {56 vars in 1113 bytes} [Thu Jul 14 17:05:09 2022] GET /identity/v3/services?name=image => generated 123 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 17:05:09.906550 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66f307e-96b7-46f9-a8a8-6c63b0df0294 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:05:09.926541 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b99e5d5-3cfb-466f-bf70-de5820bfb804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:05:09.927206 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b99e5d5-3cfb-466f-bf70-de5820bfb804 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:09.927496 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b99e5d5-3cfb-466f-bf70-de5820bfb804 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:09.927778 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b99e5d5-3cfb-466f-bf70-de5820bfb804 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:09.947489 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:05:10.005684 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b99e5d5-3cfb-466f-bf70-de5820bfb804 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:05:10.007091 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b99e5d5-3cfb-466f-bf70-de5820bfb804 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:05:10.017163 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66f307e-96b7-46f9-a8a8-6c63b0df0294 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:05:10.059571 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3c959d-f09f-4189-a1d8-17ce10569705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:05:10.060301 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3c959d-f09f-4189-a1d8-17ce10569705 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:10.060594 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3c959d-f09f-4189-a1d8-17ce10569705 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:10.060877 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3c959d-f09f-4189-a1d8-17ce10569705 None admin] PATH_INFO: `/v3/services` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:10.061722 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3c959d-f09f-4189-a1d8-17ce10569705 None admin] RBAC: Adding query filter params (type=image) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:05:10.062046 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3c959d-f09f-4189-a1d8-17ce10569705 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:05:10.063461 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3c959d-f09f-4189-a1d8-17ce10569705 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:05:10.073926 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 356/724] 10.222.0.136 () {56 vars in 1113 bytes} [Thu Jul 14 17:05:09 2022] GET /identity/v3/services?type=image => generated 352 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:05:10.077949 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3c959d-f09f-4189-a1d8-17ce10569705 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:05:10.123754 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 369/725] 10.222.0.136 () {58 vars in 1287 bytes} [Thu Jul 14 17:05:09 2022] GET /identity/v3/auth/tokens => generated 1099 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 17:05:10.130349 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b99e5d5-3cfb-466f-bf70-de5820bfb804 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:05:10.148867 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:05:10.191331 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:05:10.197020 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3c959d-f09f-4189-a1d8-17ce10569705 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:05:10.237621 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1d26b5-0a3d-46fa-a44f-3bf980e6f967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:05:10.237621 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1d26b5-0a3d-46fa-a44f-3bf980e6f967 None admin] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:10.237621 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1d26b5-0a3d-46fa-a44f-3bf980e6f967 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:10.237621 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1d26b5-0a3d-46fa-a44f-3bf980e6f967 None admin] PATH_INFO: `/v3/endpoints` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:10.238052 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1d26b5-0a3d-46fa-a44f-3bf980e6f967 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:05:10.238052 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1d26b5-0a3d-46fa-a44f-3bf980e6f967 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:05:10.266619 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b99e5d5-3cfb-466f-bf70-de5820bfb804 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:05:10.269669 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 357/726] 10.222.0.136 () {60 vars in 1149 bytes} [Thu Jul 14 17:05:10 2022] POST /identity/v3/endpoints => generated 329 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 17:05:10.323292 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47230d4f-3058-44ad-b9a3-bb9350d843c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:05:10.324524 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47230d4f-3058-44ad-b9a3-bb9350d843c7 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:10.325018 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47230d4f-3058-44ad-b9a3-bb9350d843c7 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:10.325564 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47230d4f-3058-44ad-b9a3-bb9350d843c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:10.338554 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47230d4f-3058-44ad-b9a3-bb9350d843c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:05:10.340483 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47230d4f-3058-44ad-b9a3-bb9350d843c7 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:05:10.363518 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-47230d4f-3058-44ad-b9a3-bb9350d843c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:05:10.363518 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:05:10.363518 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:05:10.363518 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:05:10.363518 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:05:10.363518 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:05:10.363518 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:05:10.363518 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:05:10.363518 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:05:10.363518 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:05:10.363518 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:05:10.363518 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:05:10.363518 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 17:05:10.363518 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 17:05:10.363518 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 17:05:10.364930 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 17:05:10.364930 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:05:10.364930 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:05:10.364930 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:05:10.364930 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:05:10.364930 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:05:10.364930 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:05:10.364930 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:05:10.364930 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Jul 14 17:05:10.364930 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:05:10.364930 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:05:10.364930 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:05:10.364930 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:05:10.364930 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:05:10.364930 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:05:10.364930 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:05:10.364930 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:05:10.365872 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 17:05:10.365872 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 17:05:10.365872 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:05:10.365872 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Jul 14 17:05:10.368502 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 370/727] 10.222.0.136 () {56 vars in 1113 bytes} [Thu Jul 14 17:05:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:05:10.374826 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1d26b5-0a3d-46fa-a44f-3bf980e6f967 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:05:10.506246 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1d26b5-0a3d-46fa-a44f-3bf980e6f967 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:05:10.519578 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:05:10.528598 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce27eca-914e-4942-beb3-a6b21d0b1c4a None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:10.528886 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce27eca-914e-4942-beb3-a6b21d0b1c4a None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:10.529170 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce27eca-914e-4942-beb3-a6b21d0b1c4a None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:10.530821 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 371/728] 10.222.0.136 () {54 vars in 931 bytes} [Thu Jul 14 17:05:10 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:05:10.536309 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8926b05d-d364-492d-9f1a-0c1a0d83dff9 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:10.536596 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8926b05d-d364-492d-9f1a-0c1a0d83dff9 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:10.536879 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8926b05d-d364-492d-9f1a-0c1a0d83dff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:10.549702 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5245bb-d6e8-43b6-bf71-30178c6973cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:05:10.551042 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5245bb-d6e8-43b6-bf71-30178c6973cf None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:10.551337 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5245bb-d6e8-43b6-bf71-30178c6973cf None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:10.551615 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5245bb-d6e8-43b6-bf71-30178c6973cf None admin] PATH_INFO: `/v3/domains` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:10.552341 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5245bb-d6e8-43b6-bf71-30178c6973cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:05:10.552648 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5245bb-d6e8-43b6-bf71-30178c6973cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:05:10.554105 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5245bb-d6e8-43b6-bf71-30178c6973cf None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:05:10.556065 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-8926b05d-d364-492d-9f1a-0c1a0d83dff9 None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:05:10.558497 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-8926b05d-d364-492d-9f1a-0c1a0d83dff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:05:10.568952 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 358/729] 10.222.0.136 () {56 vars in 1114 bytes} [Thu Jul 14 17:05:10 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:05:10.574920 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5245bb-d6e8-43b6-bf71-30178c6973cf None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:05:10.658427 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 372/730] 10.222.0.136 () {58 vars in 1028 bytes} [Thu Jul 14 17:05:10 2022] POST /identity/v3/auth/tokens => generated 1249 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 17:05:10.686694 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8926b05d-d364-492d-9f1a-0c1a0d83dff9 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:05:10.701407 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5245bb-d6e8-43b6-bf71-30178c6973cf None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:05:10.716313 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:05:10.737365 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3297ce-43bf-47e2-8f8f-d64ce7eb6bc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:05:10.738746 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3297ce-43bf-47e2-8f8f-d64ce7eb6bc5 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:10.739082 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3297ce-43bf-47e2-8f8f-d64ce7eb6bc5 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:10.739416 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3297ce-43bf-47e2-8f8f-d64ce7eb6bc5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:10.746632 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3297ce-43bf-47e2-8f8f-d64ce7eb6bc5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:05:10.748140 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3297ce-43bf-47e2-8f8f-d64ce7eb6bc5 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:05:10.762531 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-8f3297ce-43bf-47e2-8f8f-d64ce7eb6bc5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 17:05:10.762531 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:05:10.762531 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:05:10.762531 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:05:10.762531 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:05:10.762531 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:05:10.762531 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:05:10.762531 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:05:10.762531 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:05:10.762531 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:05:10.762531 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:05:10.762531 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:05:10.762531 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 17:05:10.762531 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 17:05:10.762531 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 17:05:10.764551 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 17:05:10.764551 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:05:10.764551 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:05:10.764551 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:05:10.764551 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:05:10.764551 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:05:10.764551 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:05:10.764551 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:05:10.764551 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Jul 14 17:05:10.764551 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:05:10.764551 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:05:10.764551 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:05:10.764551 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:05:10.764551 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:05:10.764551 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:05:10.764551 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:05:10.764551 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:05:10.766079 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 17:05:10.766079 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 17:05:10.766079 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 17:05:10.766079 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 17:05:10.766079 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 17:05:10.766079 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 17:05:10.766079 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 17:05:10.766079 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Jul 14 17:05:10.766079 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 359/731] 10.222.0.136 () {56 vars in 1116 bytes} [Thu Jul 14 17:05:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 17:05:10.776174 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3297ce-43bf-47e2-8f8f-d64ce7eb6bc5 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:05:10.799300 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8926b05d-d364-492d-9f1a-0c1a0d83dff9 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:05:10.826477 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:05:10.860345 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dab554-3bc6-4039-87d8-1aecb3a6a7e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:05:10.862084 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dab554-3bc6-4039-87d8-1aecb3a6a7e6 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:10.863333 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dab554-3bc6-4039-87d8-1aecb3a6a7e6 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:10.864047 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dab554-3bc6-4039-87d8-1aecb3a6a7e6 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:10.865223 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dab554-3bc6-4039-87d8-1aecb3a6a7e6 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:05:10.867786 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dab554-3bc6-4039-87d8-1aecb3a6a7e6 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:05:10.889923 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-d8dab554-3bc6-4039-87d8-1aecb3a6a7e6 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 14 17:05:10.889923 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:05:10.889923 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 17:05:10.889923 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 17:05:10.889923 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 17:05:10.889923 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 17:05:10.889923 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 17:05:10.889923 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 17:05:10.889923 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 14 17:05:10.889923 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Jul 14 17:05:10.889923 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 17:05:10.889923 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Jul 14 17:05:10.889923 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:05:10.889923 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:05:10.889923 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:05:10.889923 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:05:10.890927 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:05:10.890927 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:05:10.890927 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:05:10.890927 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:05:10.890927 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:05:10.890927 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:05:10.890927 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:05:10.890927 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 17:05:10.890927 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 17:05:10.890927 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 17:05:10.890927 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 17:05:10.890927 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:05:10.890927 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:05:10.890927 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:05:10.890927 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:05:10.890927 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:05:10.892243 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:05:10.892243 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:05:10.892243 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Jul 14 17:05:10.892243 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:05:10.892243 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:05:10.892243 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:05:10.892243 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:05:10.892243 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:05:10.892243 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:05:10.892243 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:05:10.892243 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:05:10.892243 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 17:05:10.892243 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 17:05:10.892243 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 14 17:05:10.892243 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Jul 14 17:05:10.896418 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 373/732] 10.222.0.136 () {56 vars in 1134 bytes} [Thu Jul 14 17:05:10 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 17:05:10.903424 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dab554-3bc6-4039-87d8-1aecb3a6a7e6 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:05:10.911501 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3297ce-43bf-47e2-8f8f-d64ce7eb6bc5 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:05:10.960053 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de99109-02f0-4c20-ba71-6b3e9c03f91e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:05:10.961288 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de99109-02f0-4c20-ba71-6b3e9c03f91e None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:10.961624 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de99109-02f0-4c20-ba71-6b3e9c03f91e None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:10.961971 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de99109-02f0-4c20-ba71-6b3e9c03f91e None admin] PATH_INFO: `/v3/projects` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:10.963285 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de99109-02f0-4c20-ba71-6b3e9c03f91e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:05:10.963606 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de99109-02f0-4c20-ba71-6b3e9c03f91e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:05:10.965820 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de99109-02f0-4c20-ba71-6b3e9c03f91e None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:05:10.984554 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 360/733] 10.222.0.136 () {56 vars in 1153 bytes} [Thu Jul 14 17:05:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 17:05:10.991542 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de99109-02f0-4c20-ba71-6b3e9c03f91e None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:05:11.018559 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:05:11.030656 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dab554-3bc6-4039-87d8-1aecb3a6a7e6 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:05:11.073478 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8b9b97-f315-49fa-9963-d7feb1797d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:05:11.074405 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8b9b97-f315-49fa-9963-d7feb1797d08 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:11.074755 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8b9b97-f315-49fa-9963-d7feb1797d08 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:11.075119 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8b9b97-f315-49fa-9963-d7feb1797d08 None admin] PATH_INFO: `/v3/services` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:11.075903 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8b9b97-f315-49fa-9963-d7feb1797d08 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:05:11.076219 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8b9b97-f315-49fa-9963-d7feb1797d08 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:05:11.077615 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8b9b97-f315-49fa-9963-d7feb1797d08 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:05:11.083772 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 374/734] 10.222.0.136 () {56 vars in 1129 bytes} [Thu Jul 14 17:05:10 2022] GET /identity/v3/services?name=block-storage => generated 131 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:05:11.084442 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a30f317-4af6-4252-92a2-91a6cfa80a6e None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:11.084865 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a30f317-4af6-4252-92a2-91a6cfa80a6e None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:11.085025 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a30f317-4af6-4252-92a2-91a6cfa80a6e None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:11.087278 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 375/735] 10.222.0.136 () {54 vars in 931 bytes} [Thu Jul 14 17:05:11 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:05:11.089909 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a30f317-4af6-4252-92a2-91a6cfa80a6e None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:05:11.113946 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:05:11.125281 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de99109-02f0-4c20-ba71-6b3e9c03f91e None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:05:11.161241 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5b1211-2f91-4b29-93e3-d5871724743b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:05:11.161939 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5b1211-2f91-4b29-93e3-d5871724743b None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:11.162228 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5b1211-2f91-4b29-93e3-d5871724743b None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:11.162520 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5b1211-2f91-4b29-93e3-d5871724743b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:11.163356 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5b1211-2f91-4b29-93e3-d5871724743b None admin] RBAC: Adding query filter params (role.id=284c6314b4d3492085e397a87b0e3b51, scope.project.id=d57eaa6dbca24cbb99dce1fe3437ecae, user.id=bc2b7d015c2046ddacac6e682f22d0f5) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:05:11.163666 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5b1211-2f91-4b29-93e3-d5871724743b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:05:11.165135 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5b1211-2f91-4b29-93e3-d5871724743b None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:05:11.171588 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 361/736] 10.222.0.136 () {56 vars in 1379 bytes} [Thu Jul 14 17:05:10 2022] GET /identity/v3/role_assignments?user.id=bc2b7d015c2046ddacac6e682f22d0f5&scope.project.id=d57eaa6dbca24cbb99dce1fe3437ecae&role.id=284c6314b4d3492085e397a87b0e3b51 => generated 610 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:05:11.172947 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66246b58-06de-44f5-8ce5-4b093a568dd7 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:11.173240 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66246b58-06de-44f5-8ce5-4b093a568dd7 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:11.173520 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66246b58-06de-44f5-8ce5-4b093a568dd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:11.200605 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-66246b58-06de-44f5-8ce5-4b093a568dd7 None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:05:11.202018 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-66246b58-06de-44f5-8ce5-4b093a568dd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:05:11.255873 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a30f317-4af6-4252-92a2-91a6cfa80a6e None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:05:11.298627 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad984e14-26bf-4331-b4cd-b8aad230d07a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:05:11.299263 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad984e14-26bf-4331-b4cd-b8aad230d07a None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:11.299551 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad984e14-26bf-4331-b4cd-b8aad230d07a None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:11.299828 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad984e14-26bf-4331-b4cd-b8aad230d07a None admin] PATH_INFO: `/v3/services` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:11.301243 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad984e14-26bf-4331-b4cd-b8aad230d07a None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:05:11.301526 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad984e14-26bf-4331-b4cd-b8aad230d07a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:05:11.303054 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad984e14-26bf-4331-b4cd-b8aad230d07a None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:05:11.307121 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 362/737] 10.222.0.136 () {58 vars in 1028 bytes} [Thu Jul 14 17:05:11 2022] POST /identity/v3/auth/tokens => generated 1249 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 17:05:11.313358 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 376/738] 10.222.0.136 () {56 vars in 1129 bytes} [Thu Jul 14 17:05:11 2022] GET /identity/v3/services?type=block-storage => generated 369 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:05:11.321616 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66246b58-06de-44f5-8ce5-4b093a568dd7 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:05:11.342110 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad984e14-26bf-4331-b4cd-b8aad230d07a None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:05:11.372631 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:05:11.427151 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:05:11.450003 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66246b58-06de-44f5-8ce5-4b093a568dd7 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:05:11.483641 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad984e14-26bf-4331-b4cd-b8aad230d07a None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:05:11.490738 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7654bf4-99f2-4865-a9e6-59bf25f5433a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:05:11.491893 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7654bf4-99f2-4865-a9e6-59bf25f5433a None admin] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:11.492564 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7654bf4-99f2-4865-a9e6-59bf25f5433a None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:11.493136 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7654bf4-99f2-4865-a9e6-59bf25f5433a None admin] PATH_INFO: `/v3/endpoints` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:11.494523 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7654bf4-99f2-4865-a9e6-59bf25f5433a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:05:11.495756 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7654bf4-99f2-4865-a9e6-59bf25f5433a None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:05:11.518165 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 363/739] 10.222.0.136 () {60 vars in 1149 bytes} [Thu Jul 14 17:05:11 2022] POST /identity/v3/endpoints => generated 348 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 17:05:11.532558 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2e3e0c-78db-4fdf-ba32-a3d2f04b347f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:05:11.533664 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2e3e0c-78db-4fdf-ba32-a3d2f04b347f None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:11.534119 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2e3e0c-78db-4fdf-ba32-a3d2f04b347f None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:11.535148 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2e3e0c-78db-4fdf-ba32-a3d2f04b347f None admin] PATH_INFO: `/v3/services/network` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:11.535974 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2e3e0c-78db-4fdf-ba32-a3d2f04b347f None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:05:11.537528 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2e3e0c-78db-4fdf-ba32-a3d2f04b347f None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:05:11.551274 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-0e2e3e0c-78db-4fdf-ba32-a3d2f04b347f None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 14 17:05:11.551274 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:05:11.551274 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 17:05:11.551274 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 17:05:11.551274 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 17:05:11.551274 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 17:05:11.551274 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 17:05:11.551274 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 17:05:11.551274 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 14 17:05:11.551274 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Jul 14 17:05:11.551274 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 17:05:11.551274 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Jul 14 17:05:11.551274 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:05:11.551274 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:05:11.551274 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:05:11.551274 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:05:11.551274 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:05:11.552493 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:05:11.552493 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:05:11.552493 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:05:11.552493 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:05:11.552493 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:05:11.552493 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:05:11.552493 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 17:05:11.552493 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 17:05:11.552493 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 17:05:11.552493 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 17:05:11.552493 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:05:11.552493 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:05:11.552493 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:05:11.552493 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:05:11.552493 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:05:11.552493 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:05:11.553625 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:05:11.553625 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Jul 14 17:05:11.553625 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:05:11.553625 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:05:11.553625 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:05:11.553625 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:05:11.553625 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:05:11.553625 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:05:11.553625 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:05:11.553625 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:05:11.553625 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 17:05:11.553625 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 17:05:11.553625 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 14 17:05:11.553625 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Jul 14 17:05:11.556251 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 377/740] 10.222.0.136 () {56 vars in 1116 bytes} [Thu Jul 14 17:05:11 2022] GET /identity/v3/services/network => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 17:05:11.562308 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7654bf4-99f2-4865-a9e6-59bf25f5433a None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:05:11.698325 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7654bf4-99f2-4865-a9e6-59bf25f5433a None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:05:11.737255 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd5a85c-2306-4794-96be-eb0c78683c04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:05:11.738014 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd5a85c-2306-4794-96be-eb0c78683c04 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:11.738304 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd5a85c-2306-4794-96be-eb0c78683c04 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:11.738569 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd5a85c-2306-4794-96be-eb0c78683c04 None admin] PATH_INFO: `/v3/services` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:11.739278 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd5a85c-2306-4794-96be-eb0c78683c04 None admin] RBAC: Adding query filter params (name=network) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:05:11.739588 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd5a85c-2306-4794-96be-eb0c78683c04 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:05:11.741029 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd5a85c-2306-4794-96be-eb0c78683c04 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:05:11.746396 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 364/741] 10.222.0.136 () {56 vars in 1117 bytes} [Thu Jul 14 17:05:11 2022] GET /identity/v3/services?name=network => generated 125 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:05:11.752147 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2e3e0c-78db-4fdf-ba32-a3d2f04b347f None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:05:11.856901 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:05:11.881324 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2e3e0c-78db-4fdf-ba32-a3d2f04b347f None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:05:11.916828 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd59274-bff9-4559-8680-3217a9ccc427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:05:11.917495 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd59274-bff9-4559-8680-3217a9ccc427 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:11.917802 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd59274-bff9-4559-8680-3217a9ccc427 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:11.918079 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd59274-bff9-4559-8680-3217a9ccc427 None admin] PATH_INFO: `/v3/services` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:11.918788 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd59274-bff9-4559-8680-3217a9ccc427 None admin] RBAC: Adding query filter params (type=network) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:05:11.919096 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd59274-bff9-4559-8680-3217a9ccc427 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:05:11.920446 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd59274-bff9-4559-8680-3217a9ccc427 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:05:11.925742 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 378/742] 10.222.0.136 () {56 vars in 1117 bytes} [Thu Jul 14 17:05:11 2022] GET /identity/v3/services?type=network => generated 352 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:05:11.931325 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd5a85c-2306-4794-96be-eb0c78683c04 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:05:11.935320 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:05:12.162861 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd5a85c-2306-4794-96be-eb0c78683c04 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:05:12.198946 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c761401d-44ca-4f41-8c52-bbd632da2735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:05:12.199912 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c761401d-44ca-4f41-8c52-bbd632da2735 None admin] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:12.200366 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c761401d-44ca-4f41-8c52-bbd632da2735 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:12.200842 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c761401d-44ca-4f41-8c52-bbd632da2735 None admin] PATH_INFO: `/v3/endpoints` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:12.201806 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c761401d-44ca-4f41-8c52-bbd632da2735 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:05:12.203342 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c761401d-44ca-4f41-8c52-bbd632da2735 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:05:12.230801 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 365/743] 10.222.0.136 () {60 vars in 1149 bytes} [Thu Jul 14 17:05:11 2022] POST /identity/v3/endpoints => generated 329 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 17:05:12.802296 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f9bcea-e1b1-4967-9e73-fca770d7b705 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:12.802853 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f9bcea-e1b1-4967-9e73-fca770d7b705 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:12.802853 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f9bcea-e1b1-4967-9e73-fca770d7b705 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:12.804358 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 379/744] 10.222.0.136 () {54 vars in 931 bytes} [Thu Jul 14 17:05:12 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:05:12.809420 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ad2060-566c-4c95-973f-1f896405ffec None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:12.809844 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ad2060-566c-4c95-973f-1f896405ffec None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:12.810102 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ad2060-566c-4c95-973f-1f896405ffec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:12.830045 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-86ad2060-566c-4c95-973f-1f896405ffec None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:05:12.832276 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-86ad2060-566c-4c95-973f-1f896405ffec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:05:12.895468 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:05:12.914601 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 366/745] 10.222.0.136 () {58 vars in 1028 bytes} [Thu Jul 14 17:05:12 2022] POST /identity/v3/auth/tokens => generated 1399 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 17:05:12.938461 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f9bcea-e1b1-4967-9e73-fca770d7b705 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:05:13.046280 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f9bcea-e1b1-4967-9e73-fca770d7b705 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:05:13.081935 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb1c72f-52a1-4fee-85fd-c8c8c9179da6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:05:13.082800 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb1c72f-52a1-4fee-85fd-c8c8c9179da6 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:13.082800 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb1c72f-52a1-4fee-85fd-c8c8c9179da6 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:13.083152 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb1c72f-52a1-4fee-85fd-c8c8c9179da6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:13.095683 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:05:13.173497 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb1c72f-52a1-4fee-85fd-c8c8c9179da6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:05:13.175599 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb1c72f-52a1-4fee-85fd-c8c8c9179da6 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:05:13.289526 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 380/746] 10.222.0.136 () {58 vars in 1287 bytes} [Thu Jul 14 17:05:12 2022] GET /identity/v3/auth/tokens => generated 1399 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 17:05:13.295394 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ad2060-566c-4c95-973f-1f896405ffec None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:05:13.401491 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ad2060-566c-4c95-973f-1f896405ffec None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:05:13.436396 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd3f6b9-b763-40ca-8cf9-9128ab2941ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:05:13.437203 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd3f6b9-b763-40ca-8cf9-9128ab2941ec None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:13.437493 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd3f6b9-b763-40ca-8cf9-9128ab2941ec None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:13.437808 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd3f6b9-b763-40ca-8cf9-9128ab2941ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:13.452068 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd3f6b9-b763-40ca-8cf9-9128ab2941ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:05:13.453562 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd3f6b9-b763-40ca-8cf9-9128ab2941ec None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:05:13.473723 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-acd3f6b9-b763-40ca-8cf9-9128ab2941ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:05:13.473723 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:05:13.473723 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:05:13.473723 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:05:13.473723 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:05:13.473723 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:05:13.473723 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:05:13.473723 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:05:13.473723 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:05:13.473723 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:05:13.473723 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:05:13.473723 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:05:13.473723 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 17:05:13.473723 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 17:05:13.473723 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 17:05:13.474700 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 17:05:13.474700 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:05:13.474700 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:05:13.474700 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:05:13.474700 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:05:13.474700 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:05:13.474700 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:05:13.474700 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:05:13.474700 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Jul 14 17:05:13.474700 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:05:13.474700 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:05:13.474700 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:05:13.474700 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:05:13.474700 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:05:13.474700 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:05:13.474700 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:05:13.474700 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:05:13.475690 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 17:05:13.475690 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 17:05:13.475690 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:05:13.475690 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Jul 14 17:05:13.477934 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 367/747] 10.222.0.136 () {56 vars in 1113 bytes} [Thu Jul 14 17:05:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:05:13.481263 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb1c72f-52a1-4fee-85fd-c8c8c9179da6 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:05:13.531395 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:05:13.592956 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb1c72f-52a1-4fee-85fd-c8c8c9179da6 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:05:13.629391 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08365601-beff-4a32-a714-088699bed84f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:05:13.630089 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08365601-beff-4a32-a714-088699bed84f None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:13.630377 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08365601-beff-4a32-a714-088699bed84f None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:13.630657 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08365601-beff-4a32-a714-088699bed84f None admin] PATH_INFO: `/v3/domains` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:13.631392 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08365601-beff-4a32-a714-088699bed84f None admin] RBAC: Adding query filter params (name=Default) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:05:13.631705 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08365601-beff-4a32-a714-088699bed84f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:05:13.633075 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08365601-beff-4a32-a714-088699bed84f None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:05:13.645179 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 381/748] 10.222.0.136 () {56 vars in 1114 bytes} [Thu Jul 14 17:05:13 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:05:13.646858 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e019b06c-1bf1-461e-ac7c-d9c8c1064986 None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:13.647220 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e019b06c-1bf1-461e-ac7c-d9c8c1064986 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:13.647588 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e019b06c-1bf1-461e-ac7c-d9c8c1064986 None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:13.649044 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 368/749] 10.222.0.136 () {54 vars in 931 bytes} [Thu Jul 14 17:05:13 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:05:13.654703 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aa64fd-0c5d-44ba-8874-01c712968cb8 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:13.654982 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aa64fd-0c5d-44ba-8874-01c712968cb8 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:13.655197 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aa64fd-0c5d-44ba-8874-01c712968cb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:13.673041 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-39aa64fd-0c5d-44ba-8874-01c712968cb8 None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:05:13.674306 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-39aa64fd-0c5d-44ba-8874-01c712968cb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:05:13.758418 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 382/750] 10.222.0.136 () {58 vars in 1028 bytes} [Thu Jul 14 17:05:13 2022] POST /identity/v3/auth/tokens => generated 1399 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 17:05:13.784036 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e019b06c-1bf1-461e-ac7c-d9c8c1064986 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:05:13.833967 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:05:13.906472 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e019b06c-1bf1-461e-ac7c-d9c8c1064986 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:05:13.942679 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86ab2eb-050a-43bc-b359-875b0804c5ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:05:13.943644 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ab2eb-050a-43bc-b359-875b0804c5ac None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:13.943934 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ab2eb-050a-43bc-b359-875b0804c5ac None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:13.944215 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ab2eb-050a-43bc-b359-875b0804c5ac None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:13.944875 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86ab2eb-050a-43bc-b359-875b0804c5ac None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:05:13.946298 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86ab2eb-050a-43bc-b359-875b0804c5ac None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:05:13.959706 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-f86ab2eb-050a-43bc-b359-875b0804c5ac None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 14 17:05:13.959706 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:05:13.959706 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 17:05:13.959706 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 17:05:13.959706 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 17:05:13.959706 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 17:05:13.959706 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 17:05:13.959706 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 17:05:13.959706 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 14 17:05:13.959706 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Jul 14 17:05:13.959706 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 17:05:13.959706 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Jul 14 17:05:13.959706 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:05:13.959706 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:05:13.959706 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:05:13.959706 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:05:13.960737 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:05:13.960737 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:05:13.960737 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:05:13.960737 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:05:13.960737 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:05:13.960737 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:05:13.960737 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:05:13.960737 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 17:05:13.960737 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 17:05:13.960737 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 17:05:13.960737 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 17:05:13.960737 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:05:13.960737 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:05:13.960737 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:05:13.960737 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:05:13.960737 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:05:13.961798 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:05:13.961798 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:05:13.961798 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Jul 14 17:05:13.961798 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:05:13.961798 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:05:13.961798 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:05:13.961798 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:05:13.961798 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:05:13.961798 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:05:13.961798 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:05:13.961798 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:05:13.961798 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 17:05:13.961798 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 17:05:13.961798 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 14 17:05:13.961798 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Jul 14 17:05:13.961798 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 369/751] 10.222.0.136 () {56 vars in 1137 bytes} [Thu Jul 14 17:05:13 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:05:13.966931 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aa64fd-0c5d-44ba-8874-01c712968cb8 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:05:13.996321 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c1db9a-9f28-45ce-8271-916ba4bfb2df None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:13.996617 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c1db9a-9f28-45ce-8271-916ba4bfb2df None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:13.996899 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c1db9a-9f28-45ce-8271-916ba4bfb2df None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:13.998348 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 370/752] 10.222.0.136 () {54 vars in 931 bytes} [Thu Jul 14 17:05:13 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 14 17:05:14.003096 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:05:14.003815 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9e6082-10d7-4627-bdf7-951a888c3c44 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:14.004062 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9e6082-10d7-4627-bdf7-951a888c3c44 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:14.004345 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9e6082-10d7-4627-bdf7-951a888c3c44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:14.020880 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-9a9e6082-10d7-4627-bdf7-951a888c3c44 None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:05:14.022085 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-9a9e6082-10d7-4627-bdf7-951a888c3c44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:05:14.076774 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aa64fd-0c5d-44ba-8874-01c712968cb8 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:05:14.091333 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 371/753] 10.222.0.136 () {58 vars in 1028 bytes} [Thu Jul 14 17:05:14 2022] POST /identity/v3/auth/tokens => generated 1399 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 17:05:14.113338 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f162e337-3313-4aa4-8e80-3a73ce1f6234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:05:14.114030 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f162e337-3313-4aa4-8e80-3a73ce1f6234 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:14.114316 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f162e337-3313-4aa4-8e80-3a73ce1f6234 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:14.114593 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f162e337-3313-4aa4-8e80-3a73ce1f6234 None admin] PATH_INFO: `/v3/services` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:14.115399 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f162e337-3313-4aa4-8e80-3a73ce1f6234 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:05:14.115714 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f162e337-3313-4aa4-8e80-3a73ce1f6234 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:05:14.116040 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9e6082-10d7-4627-bdf7-951a888c3c44 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:05:14.117090 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f162e337-3313-4aa4-8e80-3a73ce1f6234 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:05:14.126688 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 383/754] 10.222.0.136 () {56 vars in 1131 bytes} [Thu Jul 14 17:05:13 2022] GET /identity/v3/services?name=compute_legacy => generated 132 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:05:14.128179 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f162e337-3313-4aa4-8e80-3a73ce1f6234 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:05:14.148020 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:05:14.223853 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9e6082-10d7-4627-bdf7-951a888c3c44 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:05:14.230791 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:05:14.236916 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f162e337-3313-4aa4-8e80-3a73ce1f6234 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:05:14.259450 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26992f10-11cf-4a13-b315-dd7aee64bfbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:05:14.260255 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26992f10-11cf-4a13-b315-dd7aee64bfbb None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:14.260542 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26992f10-11cf-4a13-b315-dd7aee64bfbb None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:14.260823 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26992f10-11cf-4a13-b315-dd7aee64bfbb None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:14.261477 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26992f10-11cf-4a13-b315-dd7aee64bfbb None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:05:14.262905 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26992f10-11cf-4a13-b315-dd7aee64bfbb None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:05:14.272685 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0613b9-9036-49a1-9c45-363de275908b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:05:14.273344 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0613b9-9036-49a1-9c45-363de275908b None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:14.273691 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0613b9-9036-49a1-9c45-363de275908b None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:14.274002 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0613b9-9036-49a1-9c45-363de275908b None admin] PATH_INFO: `/v3/services` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:14.274613 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-26992f10-11cf-4a13-b315-dd7aee64bfbb None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 14 17:05:14.274613 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:05:14.274613 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 17:05:14.274613 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 17:05:14.274613 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 17:05:14.274613 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 17:05:14.274613 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 17:05:14.274613 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 17:05:14.274613 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 14 17:05:14.274613 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Jul 14 17:05:14.274613 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 17:05:14.274613 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Jul 14 17:05:14.274613 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:05:14.274613 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:05:14.274613 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:05:14.274613 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:05:14.274613 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:05:14.275714 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:05:14.275714 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:05:14.275714 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:05:14.275714 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:05:14.275714 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:05:14.275714 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:05:14.275714 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 17:05:14.275714 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 17:05:14.275714 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 17:05:14.275714 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 17:05:14.275714 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:05:14.275714 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:05:14.275714 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:05:14.275714 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:05:14.275714 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:05:14.275714 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:05:14.276727 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:05:14.276727 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Jul 14 17:05:14.276727 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:05:14.276727 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:05:14.276727 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:05:14.276727 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:05:14.276727 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:05:14.276727 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:05:14.276727 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:05:14.276727 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:05:14.276727 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 17:05:14.276727 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 17:05:14.276727 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 14 17:05:14.276727 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Jul 14 17:05:14.277827 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0613b9-9036-49a1-9c45-363de275908b None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:05:14.277827 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0613b9-9036-49a1-9c45-363de275908b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:05:14.277954 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 372/755] 10.222.0.136 () {56 vars in 1119 bytes} [Thu Jul 14 17:05:14 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 17:05:14.278035 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0613b9-9036-49a1-9c45-363de275908b None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:05:14.281561 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26992f10-11cf-4a13-b315-dd7aee64bfbb None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:05:14.289615 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 384/756] 10.222.0.136 () {56 vars in 1131 bytes} [Thu Jul 14 17:05:14 2022] GET /identity/v3/services?type=compute_legacy => generated 132 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:05:14.384114 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:05:14.390438 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26992f10-11cf-4a13-b315-dd7aee64bfbb None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:05:14.426566 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1a6ae9-1ed8-4e41-b787-e734c8b4bf32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:05:14.427245 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1a6ae9-1ed8-4e41-b787-e734c8b4bf32 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:14.427532 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1a6ae9-1ed8-4e41-b787-e734c8b4bf32 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:14.427811 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1a6ae9-1ed8-4e41-b787-e734c8b4bf32 None admin] PATH_INFO: `/v3/services` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:14.428589 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1a6ae9-1ed8-4e41-b787-e734c8b4bf32 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:05:14.428929 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1a6ae9-1ed8-4e41-b787-e734c8b4bf32 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:05:14.430361 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1a6ae9-1ed8-4e41-b787-e734c8b4bf32 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:05:14.435482 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 373/757] 10.222.0.136 () {56 vars in 1119 bytes} [Thu Jul 14 17:05:14 2022] GET /identity/v3/services?name=volumev3 => generated 126 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 17:05:14.441403 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0613b9-9036-49a1-9c45-363de275908b None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:05:14.550644 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0613b9-9036-49a1-9c45-363de275908b None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:05:14.585147 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6b615a-d5f5-4cd1-b51f-d31a6157e040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:05:14.585829 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6b615a-d5f5-4cd1-b51f-d31a6157e040 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:14.586114 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6b615a-d5f5-4cd1-b51f-d31a6157e040 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:14.586391 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6b615a-d5f5-4cd1-b51f-d31a6157e040 None admin] PATH_INFO: `/v3/services` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:14.587096 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6b615a-d5f5-4cd1-b51f-d31a6157e040 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:05:14.587403 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6b615a-d5f5-4cd1-b51f-d31a6157e040 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:05:14.588751 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6b615a-d5f5-4cd1-b51f-d31a6157e040 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:05:14.593173 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 385/758] 10.222.0.136 () {56 vars in 1119 bytes} [Thu Jul 14 17:05:14 2022] GET /identity/v3/services?type=volumev3 => generated 126 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:05:16.614214 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861c82a4-1b27-46fe-8858-813114e8ebea None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:16.614757 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861c82a4-1b27-46fe-8858-813114e8ebea None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:16.614757 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861c82a4-1b27-46fe-8858-813114e8ebea None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:16.616062 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 374/759] 10.222.0.136 () {54 vars in 931 bytes} [Thu Jul 14 17:05:16 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:05:16.621322 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f9d127-7db5-474a-862f-91f46f761b71 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:16.621749 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f9d127-7db5-474a-862f-91f46f761b71 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:16.622056 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f9d127-7db5-474a-862f-91f46f761b71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:16.639303 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-11f9d127-7db5-474a-862f-91f46f761b71 None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:05:16.640495 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-11f9d127-7db5-474a-862f-91f46f761b71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:05:16.658806 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:05:16.709934 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 386/760] 10.222.0.136 () {58 vars in 1028 bytes} [Thu Jul 14 17:05:16 2022] POST /identity/v3/auth/tokens => generated 1399 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 17:05:16.734522 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861c82a4-1b27-46fe-8858-813114e8ebea None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:05:16.845668 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861c82a4-1b27-46fe-8858-813114e8ebea None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:05:16.870394 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575dfc84-8c2b-474c-a600-b399bb627a6f None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:16.870687 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575dfc84-8c2b-474c-a600-b399bb627a6f None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:16.870970 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575dfc84-8c2b-474c-a600-b399bb627a6f None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:16.872327 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 387/761] 10.222.0.136 () {54 vars in 931 bytes} [Thu Jul 14 17:05:16 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 14 17:05:16.877202 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15a358b-e565-41da-b32b-5317d7b6ae23 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:16.877570 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15a358b-e565-41da-b32b-5317d7b6ae23 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:16.878469 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15a358b-e565-41da-b32b-5317d7b6ae23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:16.881239 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3555c73f-680d-4a5a-9978-a4b64d126d3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:05:16.881940 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3555c73f-680d-4a5a-9978-a4b64d126d3f None admin] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:16.882234 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3555c73f-680d-4a5a-9978-a4b64d126d3f None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:16.882521 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3555c73f-680d-4a5a-9978-a4b64d126d3f None admin] PATH_INFO: `/v3/services` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:16.883249 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3555c73f-680d-4a5a-9978-a4b64d126d3f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:05:16.885656 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3555c73f-680d-4a5a-9978-a4b64d126d3f None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:05:16.896408 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-a15a358b-e565-41da-b32b-5317d7b6ae23 None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:05:16.897766 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-a15a358b-e565-41da-b32b-5317d7b6ae23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:05:16.905868 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 375/762] 10.222.0.136 () {60 vars in 1146 bytes} [Thu Jul 14 17:05:16 2022] POST /identity/v3/services => generated 270 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 17:05:16.980960 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 388/763] 10.222.0.136 () {58 vars in 1028 bytes} [Thu Jul 14 17:05:16 2022] POST /identity/v3/auth/tokens => generated 1509 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 17:05:17.007220 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3555c73f-680d-4a5a-9978-a4b64d126d3f None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:05:17.031458 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:05:17.114973 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3555c73f-680d-4a5a-9978-a4b64d126d3f None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:05:17.147713 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d2e429-9c94-429c-9805-07a6dbed745a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:05:17.148305 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d2e429-9c94-429c-9805-07a6dbed745a None admin] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:17.148591 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d2e429-9c94-429c-9805-07a6dbed745a None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:17.148870 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d2e429-9c94-429c-9805-07a6dbed745a None admin] PATH_INFO: `/v3/services` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:17.149612 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d2e429-9c94-429c-9805-07a6dbed745a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:05:17.150966 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d2e429-9c94-429c-9805-07a6dbed745a None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:05:17.164249 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 376/764] 10.222.0.136 () {60 vars in 1146 bytes} [Thu Jul 14 17:05:17 2022] POST /identity/v3/services => generated 252 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 17:05:19.156837 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5100c6-2ec9-4cf5-a0a4-7fa3e9e187e5 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:19.157404 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5100c6-2ec9-4cf5-a0a4-7fa3e9e187e5 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:19.157404 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5100c6-2ec9-4cf5-a0a4-7fa3e9e187e5 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:19.158844 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 389/765] 10.222.0.136 () {54 vars in 931 bytes} [Thu Jul 14 17:05:19 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:05:19.164167 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa420ee-5151-48ee-802e-c11e7f0b912b None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:19.164578 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa420ee-5151-48ee-802e-c11e7f0b912b None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:19.164737 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa420ee-5151-48ee-802e-c11e7f0b912b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:19.181710 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-caa420ee-5151-48ee-802e-c11e7f0b912b None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:05:19.182890 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-caa420ee-5151-48ee-802e-c11e7f0b912b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:05:19.258857 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 377/766] 10.222.0.136 () {58 vars in 1028 bytes} [Thu Jul 14 17:05:19 2022] POST /identity/v3/auth/tokens => generated 1610 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 17:05:19.283684 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5100c6-2ec9-4cf5-a0a4-7fa3e9e187e5 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:05:19.376992 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:05:19.397310 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5100c6-2ec9-4cf5-a0a4-7fa3e9e187e5 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:05:19.431966 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c25ca27-b555-4680-9ca5-eba70220c7f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:05:19.432692 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c25ca27-b555-4680-9ca5-eba70220c7f5 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:19.432975 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c25ca27-b555-4680-9ca5-eba70220c7f5 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:19.433248 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c25ca27-b555-4680-9ca5-eba70220c7f5 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:19.433935 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c25ca27-b555-4680-9ca5-eba70220c7f5 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:05:19.435283 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c25ca27-b555-4680-9ca5-eba70220c7f5 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:05:19.437480 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714ad6f4-2e24-4503-acdf-0ce5ad099313 None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:19.437801 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714ad6f4-2e24-4503-acdf-0ce5ad099313 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:19.438085 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714ad6f4-2e24-4503-acdf-0ce5ad099313 None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:19.439430 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 378/767] 10.222.0.136 () {54 vars in 931 bytes} [Thu Jul 14 17:05:19 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:05:19.444934 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e635b2e-e14b-47b3-a9b9-b9b10039f0db None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:19.445221 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e635b2e-e14b-47b3-a9b9-b9b10039f0db None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:19.445503 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e635b2e-e14b-47b3-a9b9-b9b10039f0db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:19.448406 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-6c25ca27-b555-4680-9ca5-eba70220c7f5 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 14 17:05:19.448406 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:05:19.448406 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 17:05:19.448406 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 17:05:19.448406 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 17:05:19.448406 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 17:05:19.448406 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 17:05:19.448406 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 17:05:19.448406 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 14 17:05:19.448406 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Jul 14 17:05:19.448406 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 17:05:19.448406 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Jul 14 17:05:19.448406 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:05:19.448406 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:05:19.448406 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:05:19.448406 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:05:19.449418 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:05:19.449418 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:05:19.449418 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:05:19.449418 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:05:19.449418 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:05:19.449418 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:05:19.449418 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:05:19.449418 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 17:05:19.449418 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 17:05:19.449418 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 17:05:19.449418 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 17:05:19.449418 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:05:19.449418 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:05:19.449418 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:05:19.449418 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:05:19.449418 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:05:19.450529 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:05:19.450529 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:05:19.450529 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Jul 14 17:05:19.450529 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:05:19.450529 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:05:19.450529 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:05:19.450529 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:05:19.450529 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:05:19.450529 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:05:19.450529 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:05:19.450529 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:05:19.450529 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 17:05:19.450529 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 17:05:19.450529 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 14 17:05:19.450529 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Jul 14 17:05:19.450529 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 390/768] 10.222.0.136 () {56 vars in 1137 bytes} [Thu Jul 14 17:05:19 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:05:19.455323 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c25ca27-b555-4680-9ca5-eba70220c7f5 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:05:19.457140 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:05:19.463026 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-6e635b2e-e14b-47b3-a9b9-b9b10039f0db None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:05:19.464756 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-6e635b2e-e14b-47b3-a9b9-b9b10039f0db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:05:19.531845 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 379/769] 10.222.0.136 () {58 vars in 1028 bytes} [Thu Jul 14 17:05:19 2022] POST /identity/v3/auth/tokens => generated 1610 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 17:05:19.555482 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e635b2e-e14b-47b3-a9b9-b9b10039f0db None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:05:19.557470 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c25ca27-b555-4680-9ca5-eba70220c7f5 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:05:19.591908 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3695e0-0e1c-49d2-b196-56b22aa21082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:05:19.592570 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3695e0-0e1c-49d2-b196-56b22aa21082 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:19.592854 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3695e0-0e1c-49d2-b196-56b22aa21082 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:19.593128 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3695e0-0e1c-49d2-b196-56b22aa21082 None admin] PATH_INFO: `/v3/services` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:19.593864 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3695e0-0e1c-49d2-b196-56b22aa21082 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:05:19.594172 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3695e0-0e1c-49d2-b196-56b22aa21082 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:05:19.595523 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3695e0-0e1c-49d2-b196-56b22aa21082 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:05:19.600532 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 391/770] 10.222.0.136 () {56 vars in 1131 bytes} [Thu Jul 14 17:05:19 2022] GET /identity/v3/services?name=compute_legacy => generated 132 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 17:05:19.606458 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3695e0-0e1c-49d2-b196-56b22aa21082 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:05:19.617300 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:05:19.657381 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e635b2e-e14b-47b3-a9b9-b9b10039f0db None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:05:19.691462 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9819e783-136a-4b38-a3aa-2a70721ef53a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:05:19.692302 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9819e783-136a-4b38-a3aa-2a70721ef53a None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:19.692587 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9819e783-136a-4b38-a3aa-2a70721ef53a None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:19.692864 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9819e783-136a-4b38-a3aa-2a70721ef53a None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:19.693513 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9819e783-136a-4b38-a3aa-2a70721ef53a None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:05:19.694910 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9819e783-136a-4b38-a3aa-2a70721ef53a None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:05:19.697750 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:05:19.707221 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3695e0-0e1c-49d2-b196-56b22aa21082 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:05:19.708364 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-9819e783-136a-4b38-a3aa-2a70721ef53a None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 14 17:05:19.708364 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:05:19.708364 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 17:05:19.708364 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 17:05:19.708364 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 17:05:19.708364 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 17:05:19.708364 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 17:05:19.708364 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 17:05:19.708364 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 14 17:05:19.708364 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Jul 14 17:05:19.708364 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 17:05:19.708364 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Jul 14 17:05:19.708364 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:05:19.708364 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:05:19.708364 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:05:19.708364 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:05:19.708364 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:05:19.709535 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:05:19.709535 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:05:19.709535 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:05:19.709535 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:05:19.709535 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:05:19.709535 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:05:19.709535 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 17:05:19.709535 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 17:05:19.709535 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 17:05:19.709535 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 17:05:19.709535 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:05:19.709535 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:05:19.709535 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:05:19.709535 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:05:19.709535 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:05:19.709535 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:05:19.710601 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:05:19.710601 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Jul 14 17:05:19.710601 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:05:19.710601 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:05:19.710601 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:05:19.710601 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:05:19.710601 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:05:19.710601 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:05:19.710601 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:05:19.710601 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:05:19.710601 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 17:05:19.710601 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 17:05:19.710601 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 14 17:05:19.710601 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Jul 14 17:05:19.710601 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 380/771] 10.222.0.136 () {56 vars in 1119 bytes} [Thu Jul 14 17:05:19 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 17:05:19.715349 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9819e783-136a-4b38-a3aa-2a70721ef53a None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:05:19.745524 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b604cc-917d-4ab9-b441-cb9549ff234d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:05:19.746201 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b604cc-917d-4ab9-b441-cb9549ff234d None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:19.746493 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b604cc-917d-4ab9-b441-cb9549ff234d None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:19.746771 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b604cc-917d-4ab9-b441-cb9549ff234d None admin] PATH_INFO: `/v3/services` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:19.747482 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b604cc-917d-4ab9-b441-cb9549ff234d None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:05:19.747789 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b604cc-917d-4ab9-b441-cb9549ff234d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:05:19.749138 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b604cc-917d-4ab9-b441-cb9549ff234d None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:05:19.754803 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 392/772] 10.222.0.136 () {56 vars in 1131 bytes} [Thu Jul 14 17:05:19 2022] GET /identity/v3/services?type=compute_legacy => generated 388 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 17:05:19.760594 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b604cc-917d-4ab9-b441-cb9549ff234d None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:05:19.821903 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9819e783-136a-4b38-a3aa-2a70721ef53a None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:05:19.833510 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:05:19.855914 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a23ca7-b006-452f-acd1-7bb4f524d242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:05:19.856610 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a23ca7-b006-452f-acd1-7bb4f524d242 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:19.856896 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a23ca7-b006-452f-acd1-7bb4f524d242 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:19.857174 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a23ca7-b006-452f-acd1-7bb4f524d242 None admin] PATH_INFO: `/v3/services` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:19.857912 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a23ca7-b006-452f-acd1-7bb4f524d242 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:05:19.858225 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a23ca7-b006-452f-acd1-7bb4f524d242 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:05:19.859591 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a23ca7-b006-452f-acd1-7bb4f524d242 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:05:19.864227 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b604cc-917d-4ab9-b441-cb9549ff234d None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:05:19.864886 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 381/773] 10.222.0.136 () {56 vars in 1119 bytes} [Thu Jul 14 17:05:19 2022] GET /identity/v3/services?name=volumev3 => generated 126 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 17:05:19.870658 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a23ca7-b006-452f-acd1-7bb4f524d242 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:05:19.899031 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4380ff0a-efd7-4121-a605-2623cf2d02d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:05:19.899692 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4380ff0a-efd7-4121-a605-2623cf2d02d9 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:19.899983 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4380ff0a-efd7-4121-a605-2623cf2d02d9 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:19.900264 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4380ff0a-efd7-4121-a605-2623cf2d02d9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:19.901060 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4380ff0a-efd7-4121-a605-2623cf2d02d9 None admin] RBAC: Adding query filter params (interface=public, service_id=83aeafe141f64315add0d010a2f6b07c, region_id=RegionOne) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:05:19.901378 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4380ff0a-efd7-4121-a605-2623cf2d02d9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:05:19.902775 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4380ff0a-efd7-4121-a605-2623cf2d02d9 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:05:19.907854 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 393/774] 10.222.0.136 () {56 vars in 1256 bytes} [Thu Jul 14 17:05:19 2022] GET /identity/v3/endpoints?service_id=83aeafe141f64315add0d010a2f6b07c&interface=public®ion_id=RegionOne => generated 195 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:05:19.914272 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4380ff0a-efd7-4121-a605-2623cf2d02d9 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:05:19.932888 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:05:19.971218 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a23ca7-b006-452f-acd1-7bb4f524d242 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:05:20.006864 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa5463c-54a5-4329-a44e-9cb81b2cf41f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:05:20.007551 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa5463c-54a5-4329-a44e-9cb81b2cf41f None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:20.007824 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa5463c-54a5-4329-a44e-9cb81b2cf41f None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:20.008102 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa5463c-54a5-4329-a44e-9cb81b2cf41f None admin] PATH_INFO: `/v3/services` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:20.008808 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa5463c-54a5-4329-a44e-9cb81b2cf41f None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:05:20.009112 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa5463c-54a5-4329-a44e-9cb81b2cf41f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:05:20.010513 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa5463c-54a5-4329-a44e-9cb81b2cf41f None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:05:20.015619 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 382/775] 10.222.0.136 () {56 vars in 1119 bytes} [Thu Jul 14 17:05:19 2022] GET /identity/v3/services?type=volumev3 => generated 364 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 17:05:20.022415 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa5463c-54a5-4329-a44e-9cb81b2cf41f None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:05:20.023321 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4380ff0a-efd7-4121-a605-2623cf2d02d9 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:05:20.058455 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ff46cb-4262-4b7b-9d70-42d73d1f8650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:05:20.059143 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ff46cb-4262-4b7b-9d70-42d73d1f8650 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:20.059430 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ff46cb-4262-4b7b-9d70-42d73d1f8650 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:20.059708 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ff46cb-4262-4b7b-9d70-42d73d1f8650 None admin] PATH_INFO: `/v3/services` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:20.060395 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ff46cb-4262-4b7b-9d70-42d73d1f8650 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:05:20.061786 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ff46cb-4262-4b7b-9d70-42d73d1f8650 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:05:20.063495 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:05:20.077966 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 394/776] 10.222.0.136 () {56 vars in 1092 bytes} [Thu Jul 14 17:05:19 2022] GET /identity/v3/services => generated 1505 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 17:05:20.132163 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa5463c-54a5-4329-a44e-9cb81b2cf41f None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:05:20.162248 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:05:20.171028 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf63b149-78a5-489e-9e10-15317d22558f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:05:20.171727 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf63b149-78a5-489e-9e10-15317d22558f None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:20.171986 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf63b149-78a5-489e-9e10-15317d22558f None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:20.172269 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf63b149-78a5-489e-9e10-15317d22558f None admin] PATH_INFO: `/v3/endpoints` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:20.173073 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf63b149-78a5-489e-9e10-15317d22558f None admin] RBAC: Adding query filter params (interface=public, service_id=5a69bfc78c18444eb796b7f6ff492cc0, region_id=RegionOne) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:05:20.173393 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf63b149-78a5-489e-9e10-15317d22558f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:05:20.174883 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf63b149-78a5-489e-9e10-15317d22558f None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:05:20.181003 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 383/777] 10.222.0.136 () {56 vars in 1256 bytes} [Thu Jul 14 17:05:20 2022] GET /identity/v3/endpoints?service_id=5a69bfc78c18444eb796b7f6ff492cc0&interface=public®ion_id=RegionOne => generated 195 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 17:05:20.186936 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ff46cb-4262-4b7b-9d70-42d73d1f8650 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:05:20.294513 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ff46cb-4262-4b7b-9d70-42d73d1f8650 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:05:20.327288 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296da8d6-5cc7-4ecb-9733-ad14b5098aa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:05:20.327972 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296da8d6-5cc7-4ecb-9733-ad14b5098aa8 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:20.328254 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296da8d6-5cc7-4ecb-9733-ad14b5098aa8 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:20.328525 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296da8d6-5cc7-4ecb-9733-ad14b5098aa8 None admin] PATH_INFO: `/v3/services` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:20.329228 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296da8d6-5cc7-4ecb-9733-ad14b5098aa8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:05:20.330606 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296da8d6-5cc7-4ecb-9733-ad14b5098aa8 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:05:20.337270 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 395/778] 10.222.0.136 () {56 vars in 1092 bytes} [Thu Jul 14 17:05:20 2022] GET /identity/v3/services => generated 1505 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 17:05:22.352353 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56039dc-7b75-4810-a739-ba78f2b66905 None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:22.352900 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56039dc-7b75-4810-a739-ba78f2b66905 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:22.352900 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56039dc-7b75-4810-a739-ba78f2b66905 None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:22.354297 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 384/779] 10.222.0.136 () {54 vars in 931 bytes} [Thu Jul 14 17:05:22 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:05:22.359660 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fc0b3d-c798-4aca-9d5c-13666dc4728b None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:22.360099 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fc0b3d-c798-4aca-9d5c-13666dc4728b None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:22.360235 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fc0b3d-c798-4aca-9d5c-13666dc4728b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:22.377084 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-68fc0b3d-c798-4aca-9d5c-13666dc4728b None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:05:22.379206 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-68fc0b3d-c798-4aca-9d5c-13666dc4728b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:05:22.443571 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:05:22.452314 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 396/780] 10.222.0.136 () {58 vars in 1028 bytes} [Thu Jul 14 17:05:22 2022] POST /identity/v3/auth/tokens => generated 1610 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 17:05:22.478024 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56039dc-7b75-4810-a739-ba78f2b66905 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:05:22.571096 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6e7b98-9a4d-4d83-8aa5-0cc8fd4a9722 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:22.571575 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6e7b98-9a4d-4d83-8aa5-0cc8fd4a9722 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:22.572081 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6e7b98-9a4d-4d83-8aa5-0cc8fd4a9722 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:22.573772 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 397/781] 10.222.0.136 () {54 vars in 931 bytes} [Thu Jul 14 17:05:22 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 14 17:05:22.578861 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9229307-06f4-454a-b042-e9cdf791685c None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:22.579146 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9229307-06f4-454a-b042-e9cdf791685c None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:22.579614 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9229307-06f4-454a-b042-e9cdf791685c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:22.585839 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56039dc-7b75-4810-a739-ba78f2b66905 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:05:22.597808 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-c9229307-06f4-454a-b042-e9cdf791685c None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:05:22.599001 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-c9229307-06f4-454a-b042-e9cdf791685c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:05:22.621152 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c01e7e-0373-4a73-ba60-aa6ae8c06365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:05:22.622000 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c01e7e-0373-4a73-ba60-aa6ae8c06365 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:22.622286 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c01e7e-0373-4a73-ba60-aa6ae8c06365 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:22.622561 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c01e7e-0373-4a73-ba60-aa6ae8c06365 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:22.623204 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c01e7e-0373-4a73-ba60-aa6ae8c06365 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:05:22.624591 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c01e7e-0373-4a73-ba60-aa6ae8c06365 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:05:22.636893 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-94c01e7e-0373-4a73-ba60-aa6ae8c06365 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 14 17:05:22.636893 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:05:22.636893 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 17:05:22.636893 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 17:05:22.636893 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 17:05:22.636893 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 17:05:22.636893 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 17:05:22.636893 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 17:05:22.636893 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 14 17:05:22.636893 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Jul 14 17:05:22.636893 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 17:05:22.636893 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Jul 14 17:05:22.636893 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:05:22.636893 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:05:22.636893 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:05:22.636893 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:05:22.638074 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:05:22.638074 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:05:22.638074 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:05:22.638074 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:05:22.638074 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:05:22.638074 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:05:22.638074 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:05:22.638074 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 17:05:22.638074 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 17:05:22.638074 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 17:05:22.638074 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 17:05:22.638074 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:05:22.638074 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:05:22.638074 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:05:22.638074 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:05:22.638074 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:05:22.638958 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:05:22.638958 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:05:22.638958 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Jul 14 17:05:22.638958 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:05:22.638958 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:05:22.638958 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:05:22.638958 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:05:22.638958 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:05:22.638958 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:05:22.638958 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:05:22.638958 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:05:22.638958 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 17:05:22.638958 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 17:05:22.638958 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 14 17:05:22.638958 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Jul 14 17:05:22.638958 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 385/782] 10.222.0.136 () {56 vars in 1137 bytes} [Thu Jul 14 17:05:22 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:05:22.644652 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c01e7e-0373-4a73-ba60-aa6ae8c06365 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:05:22.668114 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 398/783] 10.222.0.136 () {58 vars in 1028 bytes} [Thu Jul 14 17:05:22 2022] POST /identity/v3/auth/tokens => generated 1610 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 17:05:22.692801 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9229307-06f4-454a-b042-e9cdf791685c None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:05:22.700068 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:05:22.744648 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c01e7e-0373-4a73-ba60-aa6ae8c06365 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:05:22.779092 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960a9b5b-4885-4ac4-af92-dc7d585ceb86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:05:22.779760 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960a9b5b-4885-4ac4-af92-dc7d585ceb86 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:22.780070 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960a9b5b-4885-4ac4-af92-dc7d585ceb86 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:22.780333 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960a9b5b-4885-4ac4-af92-dc7d585ceb86 None admin] PATH_INFO: `/v3/services` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:22.781031 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960a9b5b-4885-4ac4-af92-dc7d585ceb86 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:05:22.781340 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960a9b5b-4885-4ac4-af92-dc7d585ceb86 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:05:22.782773 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960a9b5b-4885-4ac4-af92-dc7d585ceb86 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:05:22.787815 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 386/784] 10.222.0.136 () {56 vars in 1131 bytes} [Thu Jul 14 17:05:22 2022] GET /identity/v3/services?name=compute_legacy => generated 132 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:05:22.790088 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9229307-06f4-454a-b042-e9cdf791685c None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:05:22.793472 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960a9b5b-4885-4ac4-af92-dc7d585ceb86 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:05:22.814699 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:05:22.826661 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921a6022-ea6e-4241-8362-ef8a9fa152cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:05:22.827454 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921a6022-ea6e-4241-8362-ef8a9fa152cd None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:22.827736 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921a6022-ea6e-4241-8362-ef8a9fa152cd None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:22.828017 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921a6022-ea6e-4241-8362-ef8a9fa152cd None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:22.828666 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921a6022-ea6e-4241-8362-ef8a9fa152cd None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:05:22.830082 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921a6022-ea6e-4241-8362-ef8a9fa152cd None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:05:22.841930 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-921a6022-ea6e-4241-8362-ef8a9fa152cd None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 14 17:05:22.841930 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:05:22.841930 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 17:05:22.841930 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 17:05:22.841930 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 17:05:22.841930 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 17:05:22.841930 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 17:05:22.841930 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 17:05:22.841930 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 14 17:05:22.841930 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Jul 14 17:05:22.841930 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 17:05:22.841930 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Jul 14 17:05:22.841930 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:05:22.841930 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:05:22.841930 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:05:22.841930 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:05:22.841930 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:05:22.843031 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:05:22.843031 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:05:22.843031 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:05:22.843031 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:05:22.843031 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:05:22.843031 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:05:22.843031 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 17:05:22.843031 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 17:05:22.843031 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 17:05:22.843031 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 17:05:22.843031 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:05:22.843031 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:05:22.843031 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:05:22.843031 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:05:22.843031 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:05:22.843031 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:05:22.843898 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:05:22.843898 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Jul 14 17:05:22.843898 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:05:22.843898 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:05:22.843898 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:05:22.843898 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:05:22.843898 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:05:22.843898 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:05:22.843898 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:05:22.843898 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:05:22.843898 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 17:05:22.843898 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 17:05:22.843898 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 14 17:05:22.843898 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Jul 14 17:05:22.843898 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 399/785] 10.222.0.136 () {56 vars in 1119 bytes} [Thu Jul 14 17:05:22 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 17:05:22.848973 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921a6022-ea6e-4241-8362-ef8a9fa152cd None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:05:22.897422 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960a9b5b-4885-4ac4-af92-dc7d585ceb86 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:05:22.917247 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:05:22.932767 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb910e4-2434-4602-a5e4-b30d57e42b30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:05:22.933436 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb910e4-2434-4602-a5e4-b30d57e42b30 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:22.933754 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb910e4-2434-4602-a5e4-b30d57e42b30 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:22.934040 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb910e4-2434-4602-a5e4-b30d57e42b30 None admin] PATH_INFO: `/v3/services` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:22.934738 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb910e4-2434-4602-a5e4-b30d57e42b30 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:05:22.935049 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb910e4-2434-4602-a5e4-b30d57e42b30 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:05:22.936413 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb910e4-2434-4602-a5e4-b30d57e42b30 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:05:22.941419 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 387/786] 10.222.0.136 () {56 vars in 1131 bytes} [Thu Jul 14 17:05:22 2022] GET /identity/v3/services?type=compute_legacy => generated 388 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 17:05:22.947404 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb910e4-2434-4602-a5e4-b30d57e42b30 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:05:22.949656 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921a6022-ea6e-4241-8362-ef8a9fa152cd None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:05:22.984278 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9379f62a-78c4-47f7-aee7-45eb97d40f52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:05:22.984937 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9379f62a-78c4-47f7-aee7-45eb97d40f52 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:22.985228 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9379f62a-78c4-47f7-aee7-45eb97d40f52 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:22.985510 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9379f62a-78c4-47f7-aee7-45eb97d40f52 None admin] PATH_INFO: `/v3/services` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:22.986258 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9379f62a-78c4-47f7-aee7-45eb97d40f52 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:05:22.986569 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9379f62a-78c4-47f7-aee7-45eb97d40f52 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:05:22.988152 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9379f62a-78c4-47f7-aee7-45eb97d40f52 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:05:22.997610 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 400/787] 10.222.0.136 () {56 vars in 1119 bytes} [Thu Jul 14 17:05:22 2022] GET /identity/v3/services?name=volumev3 => generated 126 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 17:05:23.000981 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9379f62a-78c4-47f7-aee7-45eb97d40f52 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:05:23.051413 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb910e4-2434-4602-a5e4-b30d57e42b30 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:05:23.058862 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:05:23.085463 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470e5937-1451-443e-8898-db91bdeeb6e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:05:23.086143 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470e5937-1451-443e-8898-db91bdeeb6e7 None admin] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:23.086430 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470e5937-1451-443e-8898-db91bdeeb6e7 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:23.086710 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470e5937-1451-443e-8898-db91bdeeb6e7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:23.087444 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470e5937-1451-443e-8898-db91bdeeb6e7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:05:23.088817 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470e5937-1451-443e-8898-db91bdeeb6e7 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:05:23.107590 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9379f62a-78c4-47f7-aee7-45eb97d40f52 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:05:23.107755 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 388/788] 10.222.0.136 () {60 vars in 1149 bytes} [Thu Jul 14 17:05:22 2022] POST /identity/v3/endpoints => generated 349 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 17:05:23.152127 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1199b385-7d29-46cb-8c32-11b7d94f0c57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:05:23.152801 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1199b385-7d29-46cb-8c32-11b7d94f0c57 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:23.153087 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1199b385-7d29-46cb-8c32-11b7d94f0c57 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:23.153363 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1199b385-7d29-46cb-8c32-11b7d94f0c57 None admin] PATH_INFO: `/v3/services` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:23.154109 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1199b385-7d29-46cb-8c32-11b7d94f0c57 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:05:23.154420 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1199b385-7d29-46cb-8c32-11b7d94f0c57 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:05:23.155795 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1199b385-7d29-46cb-8c32-11b7d94f0c57 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:05:23.162708 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 401/789] 10.222.0.136 () {56 vars in 1119 bytes} [Thu Jul 14 17:05:23 2022] GET /identity/v3/services?type=volumev3 => generated 364 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:05:23.169278 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470e5937-1451-443e-8898-db91bdeeb6e7 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:05:23.222553 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:05:23.288917 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470e5937-1451-443e-8898-db91bdeeb6e7 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:05:23.324487 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3242cc4f-80d5-420d-8119-80a3f7adb5b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:05:23.325221 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3242cc4f-80d5-420d-8119-80a3f7adb5b7 None admin] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:23.325509 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3242cc4f-80d5-420d-8119-80a3f7adb5b7 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:23.325878 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3242cc4f-80d5-420d-8119-80a3f7adb5b7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:23.326615 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3242cc4f-80d5-420d-8119-80a3f7adb5b7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:05:23.327983 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3242cc4f-80d5-420d-8119-80a3f7adb5b7 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:05:23.351647 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 389/790] 10.222.0.136 () {60 vars in 1149 bytes} [Thu Jul 14 17:05:23 2022] POST /identity/v3/endpoints => generated 348 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 17:05:25.404830 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfb1835-25c9-4ed9-8f54-0b4b070977bd None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:25.405376 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfb1835-25c9-4ed9-8f54-0b4b070977bd None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:25.405376 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfb1835-25c9-4ed9-8f54-0b4b070977bd None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:25.406781 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 402/791] 10.222.0.136 () {54 vars in 931 bytes} [Thu Jul 14 17:05:25 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:05:25.412428 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585e2428-5827-4991-ac62-a59ea47a478e None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:25.412881 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585e2428-5827-4991-ac62-a59ea47a478e None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:25.412990 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585e2428-5827-4991-ac62-a59ea47a478e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:25.430479 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-585e2428-5827-4991-ac62-a59ea47a478e None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:05:25.431675 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-585e2428-5827-4991-ac62-a59ea47a478e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:05:25.504957 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 390/792] 10.222.0.136 () {58 vars in 1028 bytes} [Thu Jul 14 17:05:25 2022] POST /identity/v3/auth/tokens => generated 1610 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 17:05:25.528984 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfb1835-25c9-4ed9-8f54-0b4b070977bd None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:05:25.631759 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfb1835-25c9-4ed9-8f54-0b4b070977bd None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:05:25.646567 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:05:25.671494 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a85201f-ed13-426e-a30a-bdc3c4c64071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:05:25.672292 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a85201f-ed13-426e-a30a-bdc3c4c64071 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:25.672580 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a85201f-ed13-426e-a30a-bdc3c4c64071 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:25.672859 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a85201f-ed13-426e-a30a-bdc3c4c64071 None admin] PATH_INFO: `/v3/services/compute` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:25.673521 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a85201f-ed13-426e-a30a-bdc3c4c64071 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:05:25.675019 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a85201f-ed13-426e-a30a-bdc3c4c64071 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:05:25.683226 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284efffa-b6f7-425c-9f0e-237162abe48c None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:25.683516 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284efffa-b6f7-425c-9f0e-237162abe48c None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:25.683797 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284efffa-b6f7-425c-9f0e-237162abe48c None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:25.685149 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 391/793] 10.222.0.136 () {54 vars in 931 bytes} [Thu Jul 14 17:05:25 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 14 17:05:25.687199 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-0a85201f-ed13-426e-a30a-bdc3c4c64071 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 14 17:05:25.687199 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:05:25.687199 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 17:05:25.687199 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 17:05:25.687199 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 17:05:25.687199 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 17:05:25.687199 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 17:05:25.687199 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 17:05:25.687199 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 14 17:05:25.687199 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Jul 14 17:05:25.687199 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 17:05:25.687199 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Jul 14 17:05:25.687199 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:05:25.687199 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:05:25.687199 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:05:25.687199 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:05:25.687199 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:05:25.688162 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:05:25.688162 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:05:25.688162 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:05:25.688162 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:05:25.688162 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:05:25.688162 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:05:25.688162 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 17:05:25.688162 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 17:05:25.688162 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 17:05:25.688162 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 17:05:25.688162 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:05:25.688162 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:05:25.688162 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:05:25.688162 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:05:25.688162 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:05:25.688162 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:05:25.688982 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:05:25.688982 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Jul 14 17:05:25.688982 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:05:25.688982 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:05:25.688982 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:05:25.688982 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:05:25.688982 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:05:25.688982 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:05:25.688982 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:05:25.688982 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:05:25.688982 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 17:05:25.688982 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 17:05:25.688982 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 14 17:05:25.688982 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Jul 14 17:05:25.688982 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 403/794] 10.222.0.136 () {56 vars in 1116 bytes} [Thu Jul 14 17:05:25 2022] GET /identity/v3/services/compute => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:05:25.691538 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6789de44-70ca-465a-a8a2-ce4a8fb0fbed None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:25.691831 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6789de44-70ca-465a-a8a2-ce4a8fb0fbed None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:25.692113 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6789de44-70ca-465a-a8a2-ce4a8fb0fbed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:25.694903 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a85201f-ed13-426e-a30a-bdc3c4c64071 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:05:25.709854 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-6789de44-70ca-465a-a8a2-ce4a8fb0fbed None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:05:25.711045 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-6789de44-70ca-465a-a8a2-ce4a8fb0fbed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:05:25.727696 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:05:25.781288 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 392/795] 10.222.0.136 () {58 vars in 1028 bytes} [Thu Jul 14 17:05:25 2022] POST /identity/v3/auth/tokens => generated 1610 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 17:05:25.805348 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a85201f-ed13-426e-a30a-bdc3c4c64071 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:05:25.806367 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6789de44-70ca-465a-a8a2-ce4a8fb0fbed None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:05:25.840154 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9df932f-02e9-4fab-9e04-3bc30729a876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:05:25.840811 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9df932f-02e9-4fab-9e04-3bc30729a876 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:25.841095 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9df932f-02e9-4fab-9e04-3bc30729a876 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:25.841373 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9df932f-02e9-4fab-9e04-3bc30729a876 None admin] PATH_INFO: `/v3/services` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:25.842102 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9df932f-02e9-4fab-9e04-3bc30729a876 None admin] RBAC: Adding query filter params (name=compute) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:05:25.842412 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9df932f-02e9-4fab-9e04-3bc30729a876 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:05:25.843755 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9df932f-02e9-4fab-9e04-3bc30729a876 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:05:25.848430 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 404/796] 10.222.0.136 () {56 vars in 1117 bytes} [Thu Jul 14 17:05:25 2022] GET /identity/v3/services?name=compute => generated 125 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 17:05:25.853979 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9df932f-02e9-4fab-9e04-3bc30729a876 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:05:25.898399 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:05:25.910239 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6789de44-70ca-465a-a8a2-ce4a8fb0fbed None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:05:25.945385 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f4e5ae-7265-4004-84a2-41dce96ea3ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:05:25.946079 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f4e5ae-7265-4004-84a2-41dce96ea3ca None admin] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:25.946372 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f4e5ae-7265-4004-84a2-41dce96ea3ca None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:25.946653 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f4e5ae-7265-4004-84a2-41dce96ea3ca None admin] PATH_INFO: `/v3/projects` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:25.947349 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f4e5ae-7265-4004-84a2-41dce96ea3ca None admin] RBAC: Authorizing `identity:create_project()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:05:25.948784 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f4e5ae-7265-4004-84a2-41dce96ea3ca None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:05:25.950172 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: WARNING keystone.server.flask.common [None req-62f4e5ae-7265-4004-84a2-41dce96ea3ca None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 14 17:05:25.958869 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9df932f-02e9-4fab-9e04-3bc30729a876 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:05:25.969636 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.sql.core [None req-62f4e5ae-7265-4004-84a2-41dce96ea3ca None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 14 17:05:25.969636 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 14 17:05:25.969636 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [parameters: {'id': '8dd7df2057da42a8ad5a8d9efcac028e', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 14 17:05:25.969636 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=98474) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 14 17:05:25.986935 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-62f4e5ae-7265-4004-84a2-41dce96ea3ca None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 8dd7df2057da42a8ad5a8d9efcac028e.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 8dd7df2057da42a8ad5a8d9efcac028e. Jul 14 17:05:25.986935 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:05:25.986935 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 14 17:05:25.986935 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 14 17:05:25.986935 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 14 17:05:25.986935 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 14 17:05:25.986935 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 14 17:05:25.986935 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application result = self._query(query) Jul 14 17:05:25.986935 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 14 17:05:25.986935 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application conn.query(q) Jul 14 17:05:25.986935 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 14 17:05:25.986935 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 14 17:05:25.986935 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 14 17:05:25.987815 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application result.read() Jul 14 17:05:25.987815 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 14 17:05:25.987815 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 14 17:05:25.987815 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 14 17:05:25.987815 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 14 17:05:25.987815 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 14 17:05:25.987815 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 14 17:05:25.987815 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 14 17:05:25.987815 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 14 17:05:25.987815 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 14 17:05:25.987815 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Jul 14 17:05:25.987815 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 14 17:05:25.987815 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Jul 14 17:05:25.987815 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:05:25.987815 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 14 17:05:25.987815 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 14 17:05:25.987815 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 14 17:05:25.987815 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 14 17:05:25.988861 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 14 17:05:25.988861 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application next(self.gen) Jul 14 17:05:25.988861 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 14 17:05:25.988861 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application yield resource Jul 14 17:05:25.988861 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 14 17:05:25.988861 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application next(self.gen) Jul 14 17:05:25.988861 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 14 17:05:25.988861 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application self.session.rollback() Jul 14 17:05:25.988861 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 14 17:05:25.988861 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application self.force_reraise() Jul 14 17:05:25.988861 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 14 17:05:25.988861 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise self.value Jul 14 17:05:25.988861 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 14 17:05:25.988861 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 14 17:05:25.988861 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 14 17:05:25.988861 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application session.commit() Jul 14 17:05:25.988861 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 14 17:05:25.989833 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 14 17:05:25.989833 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 14 17:05:25.989833 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application self._prepare_impl() Jul 14 17:05:25.989833 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 14 17:05:25.989833 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application self.session.flush() Jul 14 17:05:25.989833 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 14 17:05:25.989833 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application self._flush(objects) Jul 14 17:05:25.989833 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 14 17:05:25.989833 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 14 17:05:25.989833 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 14 17:05:25.989833 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application compat.raise_( Jul 14 17:05:25.989833 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 14 17:05:25.989833 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception Jul 14 17:05:25.989833 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 14 17:05:25.989833 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application flush_context.execute() Jul 14 17:05:25.989833 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 14 17:05:25.989833 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application rec.execute(self) Jul 14 17:05:25.990801 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 14 17:05:25.990801 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 14 17:05:25.990801 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 14 17:05:25.990801 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 14 17:05:25.990801 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 14 17:05:25.990801 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 14 17:05:25.990801 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 14 17:05:25.990801 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 14 17:05:25.990801 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 14 17:05:25.990801 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 14 17:05:25.990801 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 14 17:05:25.990801 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 14 17:05:25.990801 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 14 17:05:25.990801 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 14 17:05:25.990801 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 14 17:05:25.991663 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 14 17:05:25.991663 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 14 17:05:25.991663 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception Jul 14 17:05:25.991663 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 14 17:05:25.991663 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 14 17:05:25.991663 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 14 17:05:25.991663 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 14 17:05:25.991663 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 14 17:05:25.991663 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application result = self._query(query) Jul 14 17:05:25.991663 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 14 17:05:25.991663 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application conn.query(q) Jul 14 17:05:25.991663 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 14 17:05:25.991663 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 14 17:05:25.991663 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 14 17:05:25.991663 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application result.read() Jul 14 17:05:25.991663 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 14 17:05:25.991663 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 14 17:05:25.992557 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 14 17:05:25.992557 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 14 17:05:25.992557 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 14 17:05:25.992557 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 14 17:05:25.992557 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 14 17:05:25.992557 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 14 17:05:25.992557 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 14 17:05:25.992557 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 14 17:05:25.992557 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application [parameters: {'id': '8dd7df2057da42a8ad5a8d9efcac028e', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 14 17:05:25.992557 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 14 17:05:25.992557 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Jul 14 17:05:25.992557 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 17:05:25.992557 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Jul 14 17:05:25.992557 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:05:25.992557 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 14 17:05:25.993356 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 14 17:05:25.993356 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 14 17:05:25.993356 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 14 17:05:25.993356 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 14 17:05:25.993356 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Jul 14 17:05:25.993356 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 17:05:25.993356 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Jul 14 17:05:25.993356 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:05:25.993356 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:05:25.993356 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:05:25.993356 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:05:25.993356 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:05:25.993356 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:05:25.993356 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:05:25.993356 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:05:25.993356 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:05:25.993356 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:05:25.994333 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:05:25.994333 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 14 17:05:25.994333 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 14 17:05:25.994333 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:05:25.994333 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:05:25.994333 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 14 17:05:25.994333 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 14 17:05:25.994333 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 8dd7df2057da42a8ad5a8d9efcac028e. Jul 14 17:05:25.994333 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Jul 14 17:05:25.994333 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 393/797] 10.222.0.136 () {60 vars in 1145 bytes} [Thu Jul 14 17:05:25 2022] POST /identity/v3/projects => generated 262 bytes in 183 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 14 17:05:25.994904 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8bca29-2093-4900-ba20-dfa4cebed92c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:05:25.994904 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8bca29-2093-4900-ba20-dfa4cebed92c None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:25.994904 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8bca29-2093-4900-ba20-dfa4cebed92c None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:25.994904 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8bca29-2093-4900-ba20-dfa4cebed92c None admin] PATH_INFO: `/v3/services` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:25.996985 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8bca29-2093-4900-ba20-dfa4cebed92c None admin] RBAC: Adding query filter params (type=compute) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:05:25.996985 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8bca29-2093-4900-ba20-dfa4cebed92c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:05:25.996985 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8bca29-2093-4900-ba20-dfa4cebed92c None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:05:25.997224 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f4e5ae-7265-4004-84a2-41dce96ea3ca None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:05:26.001339 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 405/798] 10.222.0.136 () {56 vars in 1117 bytes} [Thu Jul 14 17:05:25 2022] GET /identity/v3/services?type=compute => generated 125 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:05:26.016950 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:05:26.127242 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f4e5ae-7265-4004-84a2-41dce96ea3ca None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:05:26.165206 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7034bb78-5756-41fb-a01d-91b16071b603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:05:26.166054 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7034bb78-5756-41fb-a01d-91b16071b603 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:26.166346 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7034bb78-5756-41fb-a01d-91b16071b603 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:26.166628 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7034bb78-5756-41fb-a01d-91b16071b603 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:26.174659 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7034bb78-5756-41fb-a01d-91b16071b603 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:05:26.176813 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7034bb78-5756-41fb-a01d-91b16071b603 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:05:26.192268 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-7034bb78-5756-41fb-a01d-91b16071b603 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 17:05:26.192268 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:05:26.192268 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:05:26.192268 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:05:26.192268 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:05:26.192268 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:05:26.192268 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:05:26.192268 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:05:26.192268 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:05:26.192268 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:05:26.192268 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:05:26.192268 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:05:26.192268 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 17:05:26.192268 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 17:05:26.192268 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 17:05:26.193244 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 17:05:26.193244 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:05:26.193244 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:05:26.193244 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:05:26.193244 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:05:26.193244 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:05:26.193244 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:05:26.193244 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:05:26.193244 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Jul 14 17:05:26.193244 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:05:26.193244 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:05:26.193244 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:05:26.193244 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:05:26.193244 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:05:26.193244 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:05:26.193244 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:05:26.193244 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:05:26.194187 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 17:05:26.194187 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 17:05:26.194187 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 17:05:26.194187 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 17:05:26.194187 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 17:05:26.194187 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 17:05:26.194187 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 17:05:26.194187 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Jul 14 17:05:26.197840 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 394/799] 10.222.0.136 () {56 vars in 1116 bytes} [Thu Jul 14 17:05:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 17:05:26.199563 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8bca29-2093-4900-ba20-dfa4cebed92c None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:05:26.303037 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8bca29-2093-4900-ba20-dfa4cebed92c None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:05:26.305392 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:05:26.338356 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3b1e93-030d-4f01-b681-6241c5435de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:05:26.339011 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3b1e93-030d-4f01-b681-6241c5435de4 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:26.339294 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3b1e93-030d-4f01-b681-6241c5435de4 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:26.339570 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3b1e93-030d-4f01-b681-6241c5435de4 None admin] PATH_INFO: `/v3/projects` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:26.340318 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3b1e93-030d-4f01-b681-6241c5435de4 None admin] RBAC: Adding query filter params (name=service) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:05:26.340625 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3b1e93-030d-4f01-b681-6241c5435de4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:05:26.342075 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3b1e93-030d-4f01-b681-6241c5435de4 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:05:26.361441 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 406/800] 10.222.0.136 () {56 vars in 1117 bytes} [Thu Jul 14 17:05:26 2022] GET /identity/v3/projects?name=service => generated 413 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:05:28.403282 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd521c55-c28e-4497-8f8a-8c2da7dff3d0 None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:28.403804 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd521c55-c28e-4497-8f8a-8c2da7dff3d0 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:28.403892 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd521c55-c28e-4497-8f8a-8c2da7dff3d0 None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:28.409471 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 395/801] 10.222.0.136 () {54 vars in 931 bytes} [Thu Jul 14 17:05:28 2022] GET /identity => generated 271 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:05:28.415184 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc326b2-b6af-438d-8f3e-35fda27b130c None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:28.415640 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc326b2-b6af-438d-8f3e-35fda27b130c None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:28.415865 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc326b2-b6af-438d-8f3e-35fda27b130c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:28.432398 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-0cc326b2-b6af-438d-8f3e-35fda27b130c None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:05:28.433587 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-0cc326b2-b6af-438d-8f3e-35fda27b130c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:05:28.503372 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 407/802] 10.222.0.136 () {58 vars in 1028 bytes} [Thu Jul 14 17:05:28 2022] POST /identity/v3/auth/tokens => generated 1610 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 17:05:28.527719 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd521c55-c28e-4497-8f8a-8c2da7dff3d0 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:05:28.597057 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:05:28.632442 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd521c55-c28e-4497-8f8a-8c2da7dff3d0 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:05:28.665617 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8540c76-a60d-46c7-8811-3b403de0c1c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:05:28.666286 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8540c76-a60d-46c7-8811-3b403de0c1c1 None admin] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:28.666575 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8540c76-a60d-46c7-8811-3b403de0c1c1 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:28.666856 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8540c76-a60d-46c7-8811-3b403de0c1c1 None admin] PATH_INFO: `/v3/services` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:28.667572 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8540c76-a60d-46c7-8811-3b403de0c1c1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:05:28.668935 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8540c76-a60d-46c7-8811-3b403de0c1c1 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:05:28.679174 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aa7742-ceeb-4cf1-a207-4679333d3d49 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:28.679465 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aa7742-ceeb-4cf1-a207-4679333d3d49 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:28.679757 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aa7742-ceeb-4cf1-a207-4679333d3d49 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:28.681144 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 408/803] 10.222.0.136 () {54 vars in 931 bytes} [Thu Jul 14 17:05:28 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 14 17:05:28.686784 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 396/804] 10.222.0.136 () {60 vars in 1146 bytes} [Thu Jul 14 17:05:28 2022] POST /identity/v3/services => generated 243 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 17:05:28.687021 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c46631-d514-4524-9f81-624f97b347be None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:28.687388 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c46631-d514-4524-9f81-624f97b347be None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:28.687792 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c46631-d514-4524-9f81-624f97b347be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:28.709652 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-16c46631-d514-4524-9f81-624f97b347be None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:05:28.710997 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-16c46631-d514-4524-9f81-624f97b347be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:05:28.803679 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 409/805] 10.222.0.136 () {58 vars in 1028 bytes} [Thu Jul 14 17:05:28 2022] POST /identity/v3/auth/tokens => generated 1706 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 17:05:28.830004 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8540c76-a60d-46c7-8811-3b403de0c1c1 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:05:28.933979 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8540c76-a60d-46c7-8811-3b403de0c1c1 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:05:28.961564 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:05:28.971053 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cc99ed-163c-4869-ae81-ed12a68d1857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:05:28.971822 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cc99ed-163c-4869-ae81-ed12a68d1857 None admin] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:28.972147 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cc99ed-163c-4869-ae81-ed12a68d1857 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:28.972435 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cc99ed-163c-4869-ae81-ed12a68d1857 None admin] PATH_INFO: `/v3/users` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:28.973133 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cc99ed-163c-4869-ae81-ed12a68d1857 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:05:28.974624 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cc99ed-163c-4869-ae81-ed12a68d1857 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:05:28.988718 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.sql.core [None req-71cc99ed-163c-4869-ae81-ed12a68d1857 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 14 17:05:28.988718 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 14 17:05:28.988718 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [parameters: {'user_id': '2bf3ecaee20f4e928d87ecf49ab70493', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 14 17:05:28.988718 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=98474) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 14 17:05:28.996667 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-71cc99ed-163c-4869-ae81-ed12a68d1857 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 14 17:05:28.996667 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:05:28.996667 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 14 17:05:28.996667 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 14 17:05:28.996667 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 14 17:05:28.996667 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 14 17:05:28.996667 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 14 17:05:28.996667 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application result = self._query(query) Jul 14 17:05:28.996667 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 14 17:05:28.996667 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application conn.query(q) Jul 14 17:05:28.996667 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 14 17:05:28.996667 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 14 17:05:28.996667 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 14 17:05:28.996667 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application result.read() Jul 14 17:05:28.996667 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 14 17:05:28.997810 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 14 17:05:28.997810 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 14 17:05:28.997810 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 14 17:05:28.997810 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 14 17:05:28.997810 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 14 17:05:28.997810 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 14 17:05:28.997810 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 14 17:05:28.997810 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 14 17:05:28.997810 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Jul 14 17:05:28.997810 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 14 17:05:28.997810 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Jul 14 17:05:28.997810 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:05:28.997810 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 14 17:05:28.997810 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 14 17:05:28.997810 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 14 17:05:28.997810 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 14 17:05:28.997810 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 14 17:05:28.997810 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application next(self.gen) Jul 14 17:05:28.998857 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 14 17:05:28.998857 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application yield resource Jul 14 17:05:28.998857 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 14 17:05:28.998857 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application next(self.gen) Jul 14 17:05:28.998857 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 14 17:05:28.998857 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application self.session.rollback() Jul 14 17:05:28.998857 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 14 17:05:28.998857 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application self.force_reraise() Jul 14 17:05:28.998857 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 14 17:05:28.998857 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise self.value Jul 14 17:05:28.998857 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 14 17:05:28.998857 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 14 17:05:28.998857 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 14 17:05:28.998857 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application session.commit() Jul 14 17:05:28.998857 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 14 17:05:28.998857 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 14 17:05:28.998857 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 14 17:05:28.999765 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application self._prepare_impl() Jul 14 17:05:28.999765 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 14 17:05:28.999765 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application self.session.flush() Jul 14 17:05:28.999765 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 14 17:05:28.999765 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application self._flush(objects) Jul 14 17:05:28.999765 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 14 17:05:28.999765 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 14 17:05:28.999765 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 14 17:05:28.999765 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application compat.raise_( Jul 14 17:05:28.999765 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 14 17:05:28.999765 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception Jul 14 17:05:28.999765 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 14 17:05:28.999765 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application flush_context.execute() Jul 14 17:05:28.999765 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 14 17:05:28.999765 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application rec.execute(self) Jul 14 17:05:28.999765 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 14 17:05:28.999765 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 14 17:05:29.000710 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 14 17:05:29.000710 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 14 17:05:29.000710 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 14 17:05:29.000710 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 14 17:05:29.000710 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 14 17:05:29.000710 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 14 17:05:29.000710 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 14 17:05:29.000710 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 14 17:05:29.000710 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 14 17:05:29.000710 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 14 17:05:29.000710 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 14 17:05:29.000710 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 14 17:05:29.000710 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 14 17:05:29.000710 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 14 17:05:29.000710 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 14 17:05:29.000710 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception Jul 14 17:05:29.001613 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 14 17:05:29.001613 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 14 17:05:29.001613 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 14 17:05:29.001613 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 14 17:05:29.001613 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 14 17:05:29.001613 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application result = self._query(query) Jul 14 17:05:29.001613 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 14 17:05:29.001613 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application conn.query(q) Jul 14 17:05:29.001613 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 14 17:05:29.001613 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 14 17:05:29.001613 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 14 17:05:29.001613 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application result.read() Jul 14 17:05:29.001613 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 14 17:05:29.001613 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 14 17:05:29.001613 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 14 17:05:29.001613 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 14 17:05:29.003081 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 14 17:05:29.003081 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 14 17:05:29.003081 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 14 17:05:29.003081 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 14 17:05:29.003081 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 14 17:05:29.003081 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 14 17:05:29.003081 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application [parameters: {'user_id': '2bf3ecaee20f4e928d87ecf49ab70493', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 14 17:05:29.003081 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 14 17:05:29.003081 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Jul 14 17:05:29.003081 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 17:05:29.003081 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Jul 14 17:05:29.003081 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:05:29.003081 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:05:29.003081 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:05:29.003081 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:05:29.003899 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:05:29.003899 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:05:29.003899 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:05:29.003899 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:05:29.003899 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:05:29.003899 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:05:29.003899 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:05:29.003899 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 14 17:05:29.003899 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 14 17:05:29.003899 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:05:29.003899 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:05:29.003899 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 17:05:29.003899 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 17:05:29.003899 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 17:05:29.003899 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 17:05:29.003899 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 14 17:05:29.003899 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 14 17:05:29.004850 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 14 17:05:29.004850 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 14 17:05:29.004850 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 14 17:05:29.004850 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 14 17:05:29.004850 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 14 17:05:29.004850 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Jul 14 17:05:29.004850 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 397/806] 10.222.0.136 () {60 vars in 1136 bytes} [Thu Jul 14 17:05:28 2022] POST /identity/v3/users => generated 160 bytes in 169 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:05:29.005255 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c46631-d514-4524-9f81-624f97b347be None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:05:29.027110 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:05:29.119653 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c46631-d514-4524-9f81-624f97b347be None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:05:29.155634 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd416a2e-f188-449e-ada1-e7b18bac039f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:05:29.156421 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd416a2e-f188-449e-ada1-e7b18bac039f None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:29.156705 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd416a2e-f188-449e-ada1-e7b18bac039f None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:29.156979 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd416a2e-f188-449e-ada1-e7b18bac039f None admin] PATH_INFO: `/v3/users/cinder` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:29.164752 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd416a2e-f188-449e-ada1-e7b18bac039f None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:05:29.166227 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd416a2e-f188-449e-ada1-e7b18bac039f None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:05:29.180769 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-dd416a2e-f188-449e-ada1-e7b18bac039f None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 14 17:05:29.180769 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:05:29.180769 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:05:29.180769 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:05:29.180769 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:05:29.180769 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:05:29.180769 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:05:29.180769 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:05:29.180769 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:05:29.180769 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:05:29.180769 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:05:29.180769 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:05:29.180769 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 17:05:29.180769 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 17:05:29.180769 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 17:05:29.180769 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 17:05:29.181789 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:05:29.181789 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:05:29.181789 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 17:05:29.181789 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 17:05:29.181789 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 17:05:29.181789 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 17:05:29.181789 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:05:29.181789 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:05:29.181789 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:05:29.181789 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:05:29.181789 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:05:29.181789 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Jul 14 17:05:29.181789 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:05:29.181789 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:05:29.181789 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:05:29.181789 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:05:29.181789 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:05:29.181789 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:05:29.182715 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:05:29.182715 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:05:29.182715 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 17:05:29.182715 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 17:05:29.182715 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 17:05:29.182715 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 17:05:29.182715 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 17:05:29.182715 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 17:05:29.182715 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 14 17:05:29.182715 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Jul 14 17:05:29.182715 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 410/807] 10.222.0.136 () {56 vars in 1104 bytes} [Thu Jul 14 17:05:29 2022] GET /identity/v3/users/cinder => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 17:05:29.188014 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cc99ed-163c-4869-ae81-ed12a68d1857 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:05:29.291012 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cc99ed-163c-4869-ae81-ed12a68d1857 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:05:29.323596 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6ba961-6dd0-4a02-8084-a3f292513723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:05:29.324263 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6ba961-6dd0-4a02-8084-a3f292513723 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:29.324545 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6ba961-6dd0-4a02-8084-a3f292513723 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:29.324825 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6ba961-6dd0-4a02-8084-a3f292513723 None admin] PATH_INFO: `/v3/users` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:29.325647 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6ba961-6dd0-4a02-8084-a3f292513723 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:05:29.325957 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6ba961-6dd0-4a02-8084-a3f292513723 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:05:29.327568 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6ba961-6dd0-4a02-8084-a3f292513723 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:05:29.365730 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 398/808] 10.222.0.136 () {56 vars in 1106 bytes} [Thu Jul 14 17:05:29 2022] GET /identity/v3/users?name=cinder => generated 356 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:05:31.003600 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b3be31-4948-4f6a-a01b-179f900430f3 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:31.004136 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b3be31-4948-4f6a-a01b-179f900430f3 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:31.004136 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b3be31-4948-4f6a-a01b-179f900430f3 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:31.005492 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 411/809] 10.222.0.136 () {54 vars in 931 bytes} [Thu Jul 14 17:05:31 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:05:31.010783 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22151797-bfc1-4e3d-aa1a-47172ba943c4 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:31.011222 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22151797-bfc1-4e3d-aa1a-47172ba943c4 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:31.011366 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22151797-bfc1-4e3d-aa1a-47172ba943c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:31.030346 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-22151797-bfc1-4e3d-aa1a-47172ba943c4 None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:05:31.031862 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-22151797-bfc1-4e3d-aa1a-47172ba943c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:05:31.074114 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:05:31.097883 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 399/810] 10.222.0.136 () {58 vars in 1028 bytes} [Thu Jul 14 17:05:31 2022] POST /identity/v3/auth/tokens => generated 1706 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 17:05:31.122049 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b3be31-4948-4f6a-a01b-179f900430f3 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:05:31.202966 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:05:31.225890 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b3be31-4948-4f6a-a01b-179f900430f3 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:05:31.260259 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3291c7-d56e-4790-abc6-41e43b1eaa57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:05:31.260976 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3291c7-d56e-4790-abc6-41e43b1eaa57 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:31.261261 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3291c7-d56e-4790-abc6-41e43b1eaa57 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:31.261536 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3291c7-d56e-4790-abc6-41e43b1eaa57 None admin] PATH_INFO: `/v3/services/compute` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:31.262209 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3291c7-d56e-4790-abc6-41e43b1eaa57 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:05:31.263561 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3291c7-d56e-4790-abc6-41e43b1eaa57 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:05:31.275627 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-de3291c7-d56e-4790-abc6-41e43b1eaa57 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 14 17:05:31.275627 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:05:31.275627 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 17:05:31.275627 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 17:05:31.275627 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 17:05:31.275627 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 17:05:31.275627 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 17:05:31.275627 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 17:05:31.275627 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 14 17:05:31.275627 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Jul 14 17:05:31.275627 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 17:05:31.275627 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Jul 14 17:05:31.275627 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:05:31.275627 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:05:31.275627 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:05:31.275627 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:05:31.275627 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:05:31.276787 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:05:31.276787 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:05:31.276787 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:05:31.276787 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:05:31.276787 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:05:31.276787 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:05:31.276787 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 17:05:31.276787 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 17:05:31.276787 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 17:05:31.276787 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 17:05:31.276787 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:05:31.276787 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:05:31.276787 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:05:31.276787 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:05:31.276787 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:05:31.276787 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:05:31.277671 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:05:31.277671 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Jul 14 17:05:31.277671 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:05:31.277671 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:05:31.277671 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:05:31.277671 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:05:31.277671 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:05:31.277671 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:05:31.277671 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:05:31.277671 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:05:31.277671 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 17:05:31.277671 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 17:05:31.277671 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 14 17:05:31.277671 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Jul 14 17:05:31.277671 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 412/811] 10.222.0.136 () {56 vars in 1116 bytes} [Thu Jul 14 17:05:31 2022] GET /identity/v3/services/compute => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:05:31.282870 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22151797-bfc1-4e3d-aa1a-47172ba943c4 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:05:31.381117 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22151797-bfc1-4e3d-aa1a-47172ba943c4 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:05:31.414566 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9116f01d-be34-48aa-a5d3-9360c7e13fb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:05:31.415218 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9116f01d-be34-48aa-a5d3-9360c7e13fb8 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:31.415505 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9116f01d-be34-48aa-a5d3-9360c7e13fb8 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:31.415785 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9116f01d-be34-48aa-a5d3-9360c7e13fb8 None admin] PATH_INFO: `/v3/services` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:31.416483 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9116f01d-be34-48aa-a5d3-9360c7e13fb8 None admin] RBAC: Adding query filter params (name=compute) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:05:31.416794 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9116f01d-be34-48aa-a5d3-9360c7e13fb8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:05:31.418191 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9116f01d-be34-48aa-a5d3-9360c7e13fb8 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:05:31.422936 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 400/812] 10.222.0.136 () {56 vars in 1117 bytes} [Thu Jul 14 17:05:31 2022] GET /identity/v3/services?name=compute => generated 125 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:05:31.429667 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3291c7-d56e-4790-abc6-41e43b1eaa57 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:05:31.537179 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3291c7-d56e-4790-abc6-41e43b1eaa57 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:05:31.570856 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b1ed2e-7ccb-414d-8bc5-4184f349e348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:05:31.571513 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b1ed2e-7ccb-414d-8bc5-4184f349e348 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:31.571794 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b1ed2e-7ccb-414d-8bc5-4184f349e348 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:31.572068 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b1ed2e-7ccb-414d-8bc5-4184f349e348 None admin] PATH_INFO: `/v3/services` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:31.572769 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b1ed2e-7ccb-414d-8bc5-4184f349e348 None admin] RBAC: Adding query filter params (type=compute) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:05:31.573077 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b1ed2e-7ccb-414d-8bc5-4184f349e348 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:05:31.574450 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b1ed2e-7ccb-414d-8bc5-4184f349e348 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:05:31.579147 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 413/813] 10.222.0.136 () {56 vars in 1117 bytes} [Thu Jul 14 17:05:31 2022] GET /identity/v3/services?type=compute => generated 354 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:05:31.585250 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9116f01d-be34-48aa-a5d3-9360c7e13fb8 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:05:31.628128 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:05:31.682821 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9116f01d-be34-48aa-a5d3-9360c7e13fb8 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:05:31.714603 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c875a3e1-e109-4f7e-9421-a9feb8361ee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:05:31.715255 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c875a3e1-e109-4f7e-9421-a9feb8361ee7 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:31.715538 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c875a3e1-e109-4f7e-9421-a9feb8361ee7 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:31.715814 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c875a3e1-e109-4f7e-9421-a9feb8361ee7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:31.716590 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c875a3e1-e109-4f7e-9421-a9feb8361ee7 None admin] RBAC: Adding query filter params (interface=public, service_id=da0b2e9b3564429a9a95fec4aba9bc25, region_id=RegionOne) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:05:31.716901 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c875a3e1-e109-4f7e-9421-a9feb8361ee7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:05:31.718288 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c875a3e1-e109-4f7e-9421-a9feb8361ee7 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:05:31.723818 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 401/814] 10.222.0.136 () {56 vars in 1256 bytes} [Thu Jul 14 17:05:31 2022] GET /identity/v3/endpoints?service_id=da0b2e9b3564429a9a95fec4aba9bc25&interface=public®ion_id=RegionOne => generated 195 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:05:31.730038 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b1ed2e-7ccb-414d-8bc5-4184f349e348 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:05:31.742579 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:05:31.833471 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b1ed2e-7ccb-414d-8bc5-4184f349e348 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:05:31.868130 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb73880-f4a7-4d69-ac35-890ccd2ffc3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:05:31.868785 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb73880-f4a7-4d69-ac35-890ccd2ffc3c None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:31.869068 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb73880-f4a7-4d69-ac35-890ccd2ffc3c None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:31.869346 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb73880-f4a7-4d69-ac35-890ccd2ffc3c None admin] PATH_INFO: `/v3/services` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:31.870063 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb73880-f4a7-4d69-ac35-890ccd2ffc3c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:05:31.871409 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb73880-f4a7-4d69-ac35-890ccd2ffc3c None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:05:31.878069 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 414/815] 10.222.0.136 () {56 vars in 1092 bytes} [Thu Jul 14 17:05:31 2022] GET /identity/v3/services => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 17:05:34.110576 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12480350-d24b-4ec8-8429-ae42ad6b099c None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:34.111106 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12480350-d24b-4ec8-8429-ae42ad6b099c None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:34.111198 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12480350-d24b-4ec8-8429-ae42ad6b099c None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:34.113637 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 402/816] 10.222.0.136 () {54 vars in 931 bytes} [Thu Jul 14 17:05:34 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:05:34.118720 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1ae2bf-53ca-4763-89b6-e9db0113b01b None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:34.119130 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1ae2bf-53ca-4763-89b6-e9db0113b01b None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:34.119283 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1ae2bf-53ca-4763-89b6-e9db0113b01b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:34.135770 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-8c1ae2bf-53ca-4763-89b6-e9db0113b01b None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:05:34.136952 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-8c1ae2bf-53ca-4763-89b6-e9db0113b01b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:05:34.204194 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 415/817] 10.222.0.136 () {58 vars in 1028 bytes} [Thu Jul 14 17:05:34 2022] POST /identity/v3/auth/tokens => generated 1706 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 17:05:34.229559 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12480350-d24b-4ec8-8429-ae42ad6b099c None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:05:34.328941 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12480350-d24b-4ec8-8429-ae42ad6b099c None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:05:34.336143 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:05:34.363160 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cd83f1-49c5-46ef-af94-07f0811dff62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:05:34.363877 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cd83f1-49c5-46ef-af94-07f0811dff62 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:34.364162 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cd83f1-49c5-46ef-af94-07f0811dff62 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:34.364440 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cd83f1-49c5-46ef-af94-07f0811dff62 None admin] PATH_INFO: `/v3/services/compute` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:34.365083 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cd83f1-49c5-46ef-af94-07f0811dff62 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:05:34.366474 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cd83f1-49c5-46ef-af94-07f0811dff62 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:05:34.378498 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-12cd83f1-49c5-46ef-af94-07f0811dff62 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 14 17:05:34.378498 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:05:34.378498 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 17:05:34.378498 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 17:05:34.378498 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 17:05:34.378498 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 17:05:34.378498 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 17:05:34.378498 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 17:05:34.378498 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 14 17:05:34.378498 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Jul 14 17:05:34.378498 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 17:05:34.378498 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Jul 14 17:05:34.378498 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:05:34.378498 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:05:34.378498 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:05:34.378498 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:05:34.378498 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:05:34.379640 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:05:34.379640 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:05:34.379640 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:05:34.379640 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:05:34.379640 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:05:34.379640 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:05:34.379640 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 17:05:34.379640 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 17:05:34.379640 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 17:05:34.379640 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 17:05:34.379640 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:05:34.379640 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:05:34.379640 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:05:34.379640 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:05:34.379640 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:05:34.379640 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:05:34.380657 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:05:34.380657 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Jul 14 17:05:34.380657 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:05:34.380657 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:05:34.380657 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:05:34.380657 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:05:34.380657 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:05:34.380657 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:05:34.380657 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:05:34.380657 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:05:34.380657 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 17:05:34.380657 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 17:05:34.380657 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 14 17:05:34.380657 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Jul 14 17:05:34.380657 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 403/818] 10.222.0.136 () {56 vars in 1116 bytes} [Thu Jul 14 17:05:34 2022] GET /identity/v3/services/compute => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:05:34.385697 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1ae2bf-53ca-4763-89b6-e9db0113b01b None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:05:34.387853 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:05:34.485239 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1ae2bf-53ca-4763-89b6-e9db0113b01b None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:05:34.518857 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7983ce57-80bc-444d-ab64-a720ce320e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:05:34.519502 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7983ce57-80bc-444d-ab64-a720ce320e0d None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:34.519812 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7983ce57-80bc-444d-ab64-a720ce320e0d None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:34.520181 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7983ce57-80bc-444d-ab64-a720ce320e0d None admin] PATH_INFO: `/v3/services` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:34.521042 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7983ce57-80bc-444d-ab64-a720ce320e0d None admin] RBAC: Adding query filter params (name=compute) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:05:34.521377 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7983ce57-80bc-444d-ab64-a720ce320e0d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:05:34.522771 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7983ce57-80bc-444d-ab64-a720ce320e0d None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:05:34.527457 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 416/819] 10.222.0.136 () {56 vars in 1117 bytes} [Thu Jul 14 17:05:34 2022] GET /identity/v3/services?name=compute => generated 125 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:05:34.533258 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cd83f1-49c5-46ef-af94-07f0811dff62 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:05:34.630940 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cd83f1-49c5-46ef-af94-07f0811dff62 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:05:34.663119 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04c1f4f-53c5-4560-9468-4fbed2d370a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:05:34.663772 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04c1f4f-53c5-4560-9468-4fbed2d370a7 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:34.664056 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04c1f4f-53c5-4560-9468-4fbed2d370a7 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:34.664334 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04c1f4f-53c5-4560-9468-4fbed2d370a7 None admin] PATH_INFO: `/v3/services` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:34.665031 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04c1f4f-53c5-4560-9468-4fbed2d370a7 None admin] RBAC: Adding query filter params (type=compute) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:05:34.665339 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04c1f4f-53c5-4560-9468-4fbed2d370a7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:05:34.666725 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04c1f4f-53c5-4560-9468-4fbed2d370a7 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:05:34.671379 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 404/820] 10.222.0.136 () {56 vars in 1117 bytes} [Thu Jul 14 17:05:34 2022] GET /identity/v3/services?type=compute => generated 354 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:05:34.678021 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7983ce57-80bc-444d-ab64-a720ce320e0d None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:05:34.744239 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:05:34.779211 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7983ce57-80bc-444d-ab64-a720ce320e0d None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:05:34.814049 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f052c8f6-336b-4329-9b3f-e3dfca6d86ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:05:34.814755 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f052c8f6-336b-4329-9b3f-e3dfca6d86ab None admin] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:05:34.815330 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f052c8f6-336b-4329-9b3f-e3dfca6d86ab None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:05:34.815586 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f052c8f6-336b-4329-9b3f-e3dfca6d86ab None admin] PATH_INFO: `/v3/endpoints` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:05:34.816332 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f052c8f6-336b-4329-9b3f-e3dfca6d86ab None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:05:34.817707 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f052c8f6-336b-4329-9b3f-e3dfca6d86ab None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:05:34.836802 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 417/821] 10.222.0.136 () {60 vars in 1149 bytes} [Thu Jul 14 17:05:34 2022] POST /identity/v3/endpoints => generated 336 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 17:05:44.668973 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=83 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:05:44.832619 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=38,keystone:INSERT=1 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:06:37.025239 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57504e7c-96c7-4fa2-a55a-ddac71a9e566 None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:06:37.025873 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57504e7c-96c7-4fa2-a55a-ddac71a9e566 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:06:37.025873 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57504e7c-96c7-4fa2-a55a-ddac71a9e566 None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:06:37.027210 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 405/822] 10.222.0.136 () {54 vars in 931 bytes} [Thu Jul 14 17:06:37 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:06:37.032665 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3544f26d-c33e-453f-a934-8ee0ffd415b0 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:06:37.033197 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3544f26d-c33e-453f-a934-8ee0ffd415b0 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:06:37.033296 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3544f26d-c33e-453f-a934-8ee0ffd415b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:06:37.051956 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-3544f26d-c33e-453f-a934-8ee0ffd415b0 None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:06:37.053182 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-3544f26d-c33e-453f-a934-8ee0ffd415b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:06:37.159521 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 418/823] 10.222.0.136 () {58 vars in 1028 bytes} [Thu Jul 14 17:06:37 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 17:06:37.180758 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57504e7c-96c7-4fa2-a55a-ddac71a9e566 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:06:37.320577 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57504e7c-96c7-4fa2-a55a-ddac71a9e566 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:06:37.363458 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfea29ef-1157-47c7-9fb4-a2902a00a8b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:06:37.364302 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfea29ef-1157-47c7-9fb4-a2902a00a8b9 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:06:37.364585 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfea29ef-1157-47c7-9fb4-a2902a00a8b9 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:06:37.364913 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfea29ef-1157-47c7-9fb4-a2902a00a8b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:06:37.378510 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfea29ef-1157-47c7-9fb4-a2902a00a8b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:06:37.380613 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfea29ef-1157-47c7-9fb4-a2902a00a8b9 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:06:37.403711 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-cfea29ef-1157-47c7-9fb4-a2902a00a8b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:06:37.403711 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:06:37.403711 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:06:37.403711 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:06:37.403711 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:06:37.403711 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:06:37.403711 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:06:37.403711 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:06:37.403711 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:06:37.403711 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:06:37.403711 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:06:37.403711 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:06:37.403711 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 17:06:37.403711 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 17:06:37.403711 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 17:06:37.404762 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 17:06:37.404762 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:06:37.404762 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:06:37.404762 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:06:37.404762 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:06:37.404762 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:06:37.404762 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:06:37.404762 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:06:37.404762 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Jul 14 17:06:37.404762 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:06:37.404762 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:06:37.404762 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:06:37.404762 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:06:37.404762 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:06:37.404762 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:06:37.404762 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:06:37.404762 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:06:37.405838 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 17:06:37.405838 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 17:06:37.405838 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:06:37.405838 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Jul 14 17:06:37.405838 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 406/824] 10.222.0.136 () {56 vars in 1113 bytes} [Thu Jul 14 17:06:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 17:06:37.411395 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3544f26d-c33e-453f-a934-8ee0ffd415b0 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:06:37.534292 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3544f26d-c33e-453f-a934-8ee0ffd415b0 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:06:37.564415 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:06:37.575344 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0754da9b-e77e-469d-b4b2-be2ead9967c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:06:37.576163 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0754da9b-e77e-469d-b4b2-be2ead9967c6 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:06:37.576521 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0754da9b-e77e-469d-b4b2-be2ead9967c6 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:06:37.576882 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0754da9b-e77e-469d-b4b2-be2ead9967c6 None admin] PATH_INFO: `/v3/domains` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:06:37.578672 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0754da9b-e77e-469d-b4b2-be2ead9967c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:06:37.579319 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0754da9b-e77e-469d-b4b2-be2ead9967c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:06:37.581212 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0754da9b-e77e-469d-b4b2-be2ead9967c6 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:06:37.600864 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 419/825] 10.222.0.136 () {56 vars in 1114 bytes} [Thu Jul 14 17:06:37 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:06:37.607183 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfea29ef-1157-47c7-9fb4-a2902a00a8b9 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:06:37.674383 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:06:37.728283 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfea29ef-1157-47c7-9fb4-a2902a00a8b9 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:06:37.770469 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ca442d-1f6d-4ed8-9c3b-7b5d2e75c79e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:06:37.771491 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ca442d-1f6d-4ed8-9c3b-7b5d2e75c79e None admin] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:06:37.771749 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ca442d-1f6d-4ed8-9c3b-7b5d2e75c79e None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:06:37.772069 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ca442d-1f6d-4ed8-9c3b-7b5d2e75c79e None admin] PATH_INFO: `/v3/users` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:06:37.772761 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ca442d-1f6d-4ed8-9c3b-7b5d2e75c79e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:06:37.774335 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ca442d-1f6d-4ed8-9c3b-7b5d2e75c79e None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:06:37.798399 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 407/826] 10.222.0.136 () {60 vars in 1137 bytes} [Thu Jul 14 17:06:37 2022] POST /identity/v3/users => generated 252 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 17:06:40.211060 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6dd43d-23ee-407f-b848-63446c066539 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:06:40.211532 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6dd43d-23ee-407f-b848-63446c066539 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:06:40.211680 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6dd43d-23ee-407f-b848-63446c066539 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:06:40.213686 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 420/827] 10.222.0.136 () {54 vars in 931 bytes} [Thu Jul 14 17:06:40 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:06:40.219504 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c3e594-4abb-47eb-b4e2-8a2d2584d634 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:06:40.219986 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c3e594-4abb-47eb-b4e2-8a2d2584d634 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:06:40.220141 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c3e594-4abb-47eb-b4e2-8a2d2584d634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:06:40.237824 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-d2c3e594-4abb-47eb-b4e2-8a2d2584d634 None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:06:40.239011 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-d2c3e594-4abb-47eb-b4e2-8a2d2584d634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:06:40.312763 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 408/828] 10.222.0.136 () {58 vars in 1028 bytes} [Thu Jul 14 17:06:40 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 17:06:40.340594 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6dd43d-23ee-407f-b848-63446c066539 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:06:40.461618 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6dd43d-23ee-407f-b848-63446c066539 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:06:40.498189 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319521f8-3184-4c77-a4e1-b841cfcd9d4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:06:40.499040 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319521f8-3184-4c77-a4e1-b841cfcd9d4f None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:06:40.499315 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319521f8-3184-4c77-a4e1-b841cfcd9d4f None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:06:40.499625 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319521f8-3184-4c77-a4e1-b841cfcd9d4f None admin] PATH_INFO: `/v3/roles/service` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:06:40.511224 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319521f8-3184-4c77-a4e1-b841cfcd9d4f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 17:06:40.520990 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-319521f8-3184-4c77-a4e1-b841cfcd9d4f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 17:06:40.520990 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:06:40.520990 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:06:40.520990 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:06:40.520990 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:06:40.520990 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:06:40.520990 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:06:40.520990 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:06:40.520990 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:06:40.520990 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:06:40.520990 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:06:40.520990 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:06:40.520990 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 17:06:40.520990 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 17:06:40.520990 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 17:06:40.520990 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 17:06:40.522471 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 17:06:40.522471 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 17:06:40.522471 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 17:06:40.522471 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 17:06:40.522471 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:06:40.522471 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:06:40.522471 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:06:40.522471 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:06:40.522471 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:06:40.522471 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:06:40.522471 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:06:40.522471 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Jul 14 17:06:40.522471 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:06:40.522471 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:06:40.522471 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:06:40.522471 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:06:40.523576 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:06:40.523576 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:06:40.523576 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:06:40.523576 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:06:40.523576 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 17:06:40.523576 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 17:06:40.523576 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 17:06:40.523576 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 17:06:40.523576 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 17:06:40.523576 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 17:06:40.523576 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 17:06:40.523576 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Jul 14 17:06:40.523576 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 421/829] 10.222.0.136 () {56 vars in 1107 bytes} [Thu Jul 14 17:06:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:06:40.528632 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c3e594-4abb-47eb-b4e2-8a2d2584d634 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:06:40.575070 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:06:40.645925 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c3e594-4abb-47eb-b4e2-8a2d2584d634 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:06:40.689637 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151fe04e-8de2-4aab-9e1f-c3c5a8009f41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:06:40.690376 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151fe04e-8de2-4aab-9e1f-c3c5a8009f41 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:06:40.690669 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151fe04e-8de2-4aab-9e1f-c3c5a8009f41 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:06:40.691027 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151fe04e-8de2-4aab-9e1f-c3c5a8009f41 None admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:06:40.691949 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151fe04e-8de2-4aab-9e1f-c3c5a8009f41 None admin] RBAC: Adding query filter params (name=service) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:06:40.692396 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151fe04e-8de2-4aab-9e1f-c3c5a8009f41 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:06:40.694004 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151fe04e-8de2-4aab-9e1f-c3c5a8009f41 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:06:40.703684 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 409/830] 10.222.0.136 () {56 vars in 1108 bytes} [Thu Jul 14 17:06:40 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:06:40.710804 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319521f8-3184-4c77-a4e1-b841cfcd9d4f None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:06:40.766113 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:06:40.831116 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319521f8-3184-4c77-a4e1-b841cfcd9d4f None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:06:40.871963 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2c1feb-8722-4e52-a8e9-a414dec1641e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:06:40.872747 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2c1feb-8722-4e52-a8e9-a414dec1641e None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:06:40.873031 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2c1feb-8722-4e52-a8e9-a414dec1641e None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:06:40.873305 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2c1feb-8722-4e52-a8e9-a414dec1641e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:06:40.884191 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2c1feb-8722-4e52-a8e9-a414dec1641e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:06:40.885687 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2c1feb-8722-4e52-a8e9-a414dec1641e None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:06:40.902862 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-6e2c1feb-8722-4e52-a8e9-a414dec1641e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:06:40.902862 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:06:40.902862 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:06:40.902862 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:06:40.902862 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:06:40.902862 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:06:40.902862 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:06:40.902862 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:06:40.902862 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:06:40.902862 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:06:40.902862 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:06:40.902862 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:06:40.902862 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 17:06:40.902862 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 17:06:40.902862 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 17:06:40.903950 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 17:06:40.903950 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:06:40.903950 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:06:40.903950 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:06:40.903950 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:06:40.903950 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:06:40.903950 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:06:40.903950 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:06:40.903950 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Jul 14 17:06:40.903950 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:06:40.903950 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:06:40.903950 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:06:40.903950 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:06:40.903950 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:06:40.903950 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:06:40.903950 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:06:40.903950 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:06:40.904962 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 17:06:40.904962 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 17:06:40.904962 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:06:40.904962 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Jul 14 17:06:40.904962 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 422/831] 10.222.0.136 () {56 vars in 1113 bytes} [Thu Jul 14 17:06:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:06:40.910767 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151fe04e-8de2-4aab-9e1f-c3c5a8009f41 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:06:41.026950 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:06:41.030756 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151fe04e-8de2-4aab-9e1f-c3c5a8009f41 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:06:41.070059 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b1281d-034f-41e1-85ee-f1dae6f3bd7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:06:41.070741 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b1281d-034f-41e1-85ee-f1dae6f3bd7e None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:06:41.071052 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b1281d-034f-41e1-85ee-f1dae6f3bd7e None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:06:41.071335 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b1281d-034f-41e1-85ee-f1dae6f3bd7e None admin] PATH_INFO: `/v3/domains` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:06:41.072059 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b1281d-034f-41e1-85ee-f1dae6f3bd7e None admin] RBAC: Adding query filter params (name=Default) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:06:41.072372 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b1281d-034f-41e1-85ee-f1dae6f3bd7e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:06:41.073778 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b1281d-034f-41e1-85ee-f1dae6f3bd7e None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:06:41.086541 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 410/832] 10.222.0.136 () {56 vars in 1114 bytes} [Thu Jul 14 17:06:40 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:06:41.092675 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2c1feb-8722-4e52-a8e9-a414dec1641e None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:06:41.204971 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:06:41.213631 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2c1feb-8722-4e52-a8e9-a414dec1641e None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:06:41.253565 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57162921-9ac2-4b0e-a415-e0f5bba24bf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:06:41.254376 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57162921-9ac2-4b0e-a415-e0f5bba24bf8 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:06:41.254656 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57162921-9ac2-4b0e-a415-e0f5bba24bf8 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:06:41.254928 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57162921-9ac2-4b0e-a415-e0f5bba24bf8 None admin] PATH_INFO: `/v3/users/placement` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:06:41.262937 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57162921-9ac2-4b0e-a415-e0f5bba24bf8 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:06:41.264375 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57162921-9ac2-4b0e-a415-e0f5bba24bf8 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:06:41.279090 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-57162921-9ac2-4b0e-a415-e0f5bba24bf8 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 14 17:06:41.279090 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:06:41.279090 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:06:41.279090 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:06:41.279090 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:06:41.279090 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:06:41.279090 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:06:41.279090 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:06:41.279090 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:06:41.279090 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:06:41.279090 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:06:41.279090 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:06:41.279090 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 17:06:41.279090 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 17:06:41.279090 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 17:06:41.279090 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 17:06:41.280738 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:06:41.280738 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:06:41.280738 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 17:06:41.280738 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 17:06:41.280738 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 17:06:41.280738 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 17:06:41.280738 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:06:41.280738 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:06:41.280738 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:06:41.280738 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:06:41.280738 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:06:41.280738 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Jul 14 17:06:41.280738 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:06:41.280738 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:06:41.280738 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:06:41.280738 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:06:41.280738 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:06:41.280738 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:06:41.282257 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:06:41.282257 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:06:41.282257 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 17:06:41.282257 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 17:06:41.282257 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 17:06:41.282257 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 17:06:41.282257 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 17:06:41.282257 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 17:06:41.282257 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 14 17:06:41.282257 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Jul 14 17:06:41.285783 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 423/833] 10.222.0.136 () {56 vars in 1113 bytes} [Thu Jul 14 17:06:41 2022] GET /identity/v3/users/placement => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:06:41.286691 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b1281d-034f-41e1-85ee-f1dae6f3bd7e None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:06:41.397490 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b1281d-034f-41e1-85ee-f1dae6f3bd7e None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:06:41.444191 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1cc3d8-5894-4739-bf12-f432f1cb4e9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:06:41.444912 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1cc3d8-5894-4739-bf12-f432f1cb4e9d None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:06:41.445192 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1cc3d8-5894-4739-bf12-f432f1cb4e9d None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:06:41.445474 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1cc3d8-5894-4739-bf12-f432f1cb4e9d None admin] PATH_INFO: `/v3/users` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:06:41.446384 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1cc3d8-5894-4739-bf12-f432f1cb4e9d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:06:41.446696 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1cc3d8-5894-4739-bf12-f432f1cb4e9d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:06:41.448134 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1cc3d8-5894-4739-bf12-f432f1cb4e9d None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:06:41.467145 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 411/834] 10.222.0.136 () {56 vars in 1148 bytes} [Thu Jul 14 17:06:41 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 380 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 17:06:41.474189 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57162921-9ac2-4b0e-a415-e0f5bba24bf8 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:06:41.591858 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57162921-9ac2-4b0e-a415-e0f5bba24bf8 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:06:41.631981 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0ef396-b50c-4c43-8363-8cbef1c923f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:06:41.632615 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0ef396-b50c-4c43-8363-8cbef1c923f1 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:06:41.632903 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0ef396-b50c-4c43-8363-8cbef1c923f1 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:06:41.633186 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0ef396-b50c-4c43-8363-8cbef1c923f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:06:41.663456 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:06:41.716949 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0ef396-b50c-4c43-8363-8cbef1c923f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:06:41.718953 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0ef396-b50c-4c43-8363-8cbef1c923f1 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:06:41.850810 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 424/835] 10.222.0.136 () {58 vars in 1287 bytes} [Thu Jul 14 17:06:41 2022] GET /identity/v3/auth/tokens => generated 1863 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 17:06:41.856650 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1cc3d8-5894-4739-bf12-f432f1cb4e9d None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:06:41.878025 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:06:41.980283 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1cc3d8-5894-4739-bf12-f432f1cb4e9d None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:06:42.024931 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900f08ae-f9f7-495e-919a-5784ba214603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:06:42.025795 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900f08ae-f9f7-495e-919a-5784ba214603 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:06:42.026420 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900f08ae-f9f7-495e-919a-5784ba214603 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:06:42.026718 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900f08ae-f9f7-495e-919a-5784ba214603 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:06:42.049050 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900f08ae-f9f7-495e-919a-5784ba214603 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:06:42.050796 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900f08ae-f9f7-495e-919a-5784ba214603 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:06:42.072367 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-900f08ae-f9f7-495e-919a-5784ba214603 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:06:42.072367 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:06:42.072367 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:06:42.072367 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:06:42.072367 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:06:42.072367 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:06:42.072367 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:06:42.072367 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:06:42.072367 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:06:42.072367 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:06:42.072367 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:06:42.072367 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:06:42.072367 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 17:06:42.072367 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 17:06:42.072367 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 17:06:42.073716 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 17:06:42.073716 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:06:42.073716 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:06:42.073716 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:06:42.073716 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:06:42.073716 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:06:42.073716 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:06:42.073716 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:06:42.073716 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Jul 14 17:06:42.073716 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:06:42.073716 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:06:42.073716 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:06:42.073716 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:06:42.073716 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:06:42.073716 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:06:42.073716 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:06:42.073716 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:06:42.075016 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 17:06:42.075016 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 17:06:42.075016 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:06:42.075016 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Jul 14 17:06:42.076655 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 412/836] 10.222.0.136 () {56 vars in 1113 bytes} [Thu Jul 14 17:06:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:06:42.083245 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0ef396-b50c-4c43-8363-8cbef1c923f1 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:06:42.149963 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:06:42.201171 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0ef396-b50c-4c43-8363-8cbef1c923f1 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:06:42.242932 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63131afb-9d8f-4ef5-9d0d-329b6f6b3945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:06:42.243639 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63131afb-9d8f-4ef5-9d0d-329b6f6b3945 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:06:42.243851 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63131afb-9d8f-4ef5-9d0d-329b6f6b3945 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:06:42.244128 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63131afb-9d8f-4ef5-9d0d-329b6f6b3945 None admin] PATH_INFO: `/v3/domains` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:06:42.244842 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63131afb-9d8f-4ef5-9d0d-329b6f6b3945 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:06:42.245154 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63131afb-9d8f-4ef5-9d0d-329b6f6b3945 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:06:42.246551 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63131afb-9d8f-4ef5-9d0d-329b6f6b3945 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:06:42.259622 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 425/837] 10.222.0.136 () {56 vars in 1114 bytes} [Thu Jul 14 17:06:42 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:06:42.266068 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900f08ae-f9f7-495e-919a-5784ba214603 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:06:42.349194 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:06:42.384953 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900f08ae-f9f7-495e-919a-5784ba214603 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:06:42.423984 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13fd350-658a-45d6-9b8a-5989ab8aa9b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:06:42.424945 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13fd350-658a-45d6-9b8a-5989ab8aa9b2 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:06:42.425261 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13fd350-658a-45d6-9b8a-5989ab8aa9b2 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:06:42.425729 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13fd350-658a-45d6-9b8a-5989ab8aa9b2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:06:42.434896 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13fd350-658a-45d6-9b8a-5989ab8aa9b2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:06:42.436511 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13fd350-658a-45d6-9b8a-5989ab8aa9b2 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:06:42.453203 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-f13fd350-658a-45d6-9b8a-5989ab8aa9b2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 17:06:42.453203 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:06:42.453203 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:06:42.453203 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:06:42.453203 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:06:42.453203 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:06:42.453203 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:06:42.453203 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:06:42.453203 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:06:42.453203 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:06:42.453203 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:06:42.453203 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:06:42.453203 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 17:06:42.453203 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 17:06:42.453203 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 17:06:42.454575 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 17:06:42.454575 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:06:42.454575 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:06:42.454575 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:06:42.454575 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:06:42.454575 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:06:42.454575 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:06:42.454575 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:06:42.454575 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Jul 14 17:06:42.454575 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:06:42.454575 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:06:42.454575 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:06:42.454575 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:06:42.454575 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:06:42.454575 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:06:42.454575 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:06:42.454575 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:06:42.462040 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 17:06:42.462040 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 17:06:42.462040 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 17:06:42.462040 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 17:06:42.462040 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 17:06:42.462040 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 17:06:42.462040 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 17:06:42.462040 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Jul 14 17:06:42.462040 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 413/838] 10.222.0.136 () {56 vars in 1116 bytes} [Thu Jul 14 17:06:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:06:42.462660 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63131afb-9d8f-4ef5-9d0d-329b6f6b3945 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:06:42.575528 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63131afb-9d8f-4ef5-9d0d-329b6f6b3945 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:06:42.597966 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:06:42.617351 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b35b2c-6bf9-4ed7-a495-f19765b50000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:06:42.618046 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b35b2c-6bf9-4ed7-a495-f19765b50000 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:06:42.618333 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b35b2c-6bf9-4ed7-a495-f19765b50000 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:06:42.618613 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b35b2c-6bf9-4ed7-a495-f19765b50000 None admin] PATH_INFO: `/v3/projects` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:06:42.619403 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b35b2c-6bf9-4ed7-a495-f19765b50000 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:06:42.619719 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b35b2c-6bf9-4ed7-a495-f19765b50000 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:06:42.621227 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b35b2c-6bf9-4ed7-a495-f19765b50000 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:06:42.634295 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 426/839] 10.222.0.136 () {56 vars in 1153 bytes} [Thu Jul 14 17:06:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:06:42.641197 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13fd350-658a-45d6-9b8a-5989ab8aa9b2 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:06:42.758294 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13fd350-658a-45d6-9b8a-5989ab8aa9b2 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:06:42.794824 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:06:42.805006 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd13751-f858-4bda-a427-14f5e5010fb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:06:42.805772 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd13751-f858-4bda-a427-14f5e5010fb1 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:06:42.806148 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd13751-f858-4bda-a427-14f5e5010fb1 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:06:42.806544 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd13751-f858-4bda-a427-14f5e5010fb1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:06:42.807369 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd13751-f858-4bda-a427-14f5e5010fb1 None admin] RBAC: Adding query filter params (role.id=5e0ec7345cc84921907ca95b801a656b, scope.project.id=d57eaa6dbca24cbb99dce1fe3437ecae, user.id=05cdf81bd7d14730962816677457e858) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:06:42.807772 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd13751-f858-4bda-a427-14f5e5010fb1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:06:42.809282 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd13751-f858-4bda-a427-14f5e5010fb1 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:06:42.817367 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 414/840] 10.222.0.136 () {56 vars in 1379 bytes} [Thu Jul 14 17:06:42 2022] GET /identity/v3/role_assignments?user.id=05cdf81bd7d14730962816677457e858&scope.project.id=d57eaa6dbca24cbb99dce1fe3437ecae&role.id=5e0ec7345cc84921907ca95b801a656b => generated 260 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:06:45.152248 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11df8a4-b074-4129-92f9-3e2ea4d36d84 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:06:45.152984 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11df8a4-b074-4129-92f9-3e2ea4d36d84 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:06:45.152984 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11df8a4-b074-4129-92f9-3e2ea4d36d84 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:06:45.154212 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 427/841] 10.222.0.136 () {54 vars in 931 bytes} [Thu Jul 14 17:06:45 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:06:45.160771 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca39ce7f-1d65-4145-bde2-2140f43c0578 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:06:45.161221 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca39ce7f-1d65-4145-bde2-2140f43c0578 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:06:45.161372 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca39ce7f-1d65-4145-bde2-2140f43c0578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:06:45.179996 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-ca39ce7f-1d65-4145-bde2-2140f43c0578 None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:06:45.181263 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-ca39ce7f-1d65-4145-bde2-2140f43c0578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:06:45.258001 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 415/842] 10.222.0.136 () {58 vars in 1028 bytes} [Thu Jul 14 17:06:45 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 17:06:45.284602 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11df8a4-b074-4129-92f9-3e2ea4d36d84 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:06:45.403037 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11df8a4-b074-4129-92f9-3e2ea4d36d84 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:06:45.447071 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb078eef-b161-4ac6-b444-7fdcda4d108d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:06:45.447882 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb078eef-b161-4ac6-b444-7fdcda4d108d None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:06:45.448231 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb078eef-b161-4ac6-b444-7fdcda4d108d None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:06:45.448520 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb078eef-b161-4ac6-b444-7fdcda4d108d None admin] PATH_INFO: `/v3/roles/service` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:06:45.469773 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb078eef-b161-4ac6-b444-7fdcda4d108d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 17:06:45.480003 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-eb078eef-b161-4ac6-b444-7fdcda4d108d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 17:06:45.480003 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:06:45.480003 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:06:45.480003 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:06:45.480003 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:06:45.480003 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:06:45.480003 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:06:45.480003 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:06:45.480003 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:06:45.480003 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:06:45.480003 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:06:45.480003 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:06:45.480003 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 17:06:45.480003 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 17:06:45.480003 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 17:06:45.480003 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 17:06:45.481129 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 17:06:45.481129 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 17:06:45.481129 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 17:06:45.481129 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 17:06:45.481129 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:06:45.481129 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:06:45.481129 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:06:45.481129 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:06:45.481129 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:06:45.481129 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:06:45.481129 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:06:45.481129 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Jul 14 17:06:45.481129 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:06:45.481129 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:06:45.481129 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:06:45.481129 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:06:45.488020 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:06:45.488020 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:06:45.488020 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:06:45.488020 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:06:45.488020 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 17:06:45.488020 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 17:06:45.488020 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 17:06:45.488020 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 17:06:45.488020 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 17:06:45.488020 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 17:06:45.488020 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 17:06:45.488020 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Jul 14 17:06:45.488020 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 428/843] 10.222.0.136 () {56 vars in 1107 bytes} [Thu Jul 14 17:06:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:06:45.489960 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca39ce7f-1d65-4145-bde2-2140f43c0578 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:06:45.592857 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca39ce7f-1d65-4145-bde2-2140f43c0578 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:06:45.618521 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:06:45.632898 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4b94d8-c475-4f54-a7a8-b41264a8f918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:06:45.633750 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4b94d8-c475-4f54-a7a8-b41264a8f918 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:06:45.634063 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4b94d8-c475-4f54-a7a8-b41264a8f918 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:06:45.634426 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4b94d8-c475-4f54-a7a8-b41264a8f918 None admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:06:45.635297 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4b94d8-c475-4f54-a7a8-b41264a8f918 None admin] RBAC: Adding query filter params (name=service) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:06:45.635709 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4b94d8-c475-4f54-a7a8-b41264a8f918 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:06:45.637442 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4b94d8-c475-4f54-a7a8-b41264a8f918 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:06:45.647640 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 416/844] 10.222.0.136 () {56 vars in 1108 bytes} [Thu Jul 14 17:06:45 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:06:45.653626 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb078eef-b161-4ac6-b444-7fdcda4d108d None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:06:45.695000 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:06:45.759807 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb078eef-b161-4ac6-b444-7fdcda4d108d None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:06:45.799599 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6926ddb-4d43-4aff-974d-a280dca8653f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:06:45.800697 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6926ddb-4d43-4aff-974d-a280dca8653f None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:06:45.801031 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6926ddb-4d43-4aff-974d-a280dca8653f None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:06:45.801321 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6926ddb-4d43-4aff-974d-a280dca8653f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:06:45.816325 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6926ddb-4d43-4aff-974d-a280dca8653f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:06:45.817958 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6926ddb-4d43-4aff-974d-a280dca8653f None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:06:45.838146 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-c6926ddb-4d43-4aff-974d-a280dca8653f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:06:45.838146 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:06:45.838146 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:06:45.838146 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:06:45.838146 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:06:45.838146 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:06:45.838146 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:06:45.838146 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:06:45.838146 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:06:45.838146 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:06:45.838146 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:06:45.838146 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:06:45.838146 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 17:06:45.838146 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 17:06:45.838146 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 17:06:45.839137 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 17:06:45.839137 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:06:45.839137 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:06:45.839137 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:06:45.839137 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:06:45.839137 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:06:45.839137 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:06:45.839137 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:06:45.839137 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Jul 14 17:06:45.839137 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:06:45.839137 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:06:45.839137 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:06:45.839137 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:06:45.839137 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:06:45.839137 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:06:45.839137 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:06:45.839137 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:06:45.840041 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 17:06:45.840041 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 17:06:45.840041 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:06:45.840041 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Jul 14 17:06:45.840041 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 429/845] 10.222.0.136 () {56 vars in 1113 bytes} [Thu Jul 14 17:06:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 17:06:45.845691 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4b94d8-c475-4f54-a7a8-b41264a8f918 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:06:45.957410 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4b94d8-c475-4f54-a7a8-b41264a8f918 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:06:45.993131 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c14419-0eca-4ba4-ab76-07f30b383a88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:06:45.993878 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c14419-0eca-4ba4-ab76-07f30b383a88 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:06:45.994213 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c14419-0eca-4ba4-ab76-07f30b383a88 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:06:45.994467 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c14419-0eca-4ba4-ab76-07f30b383a88 None admin] PATH_INFO: `/v3/domains` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:06:45.995300 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c14419-0eca-4ba4-ab76-07f30b383a88 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:06:45.995766 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c14419-0eca-4ba4-ab76-07f30b383a88 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:06:45.997377 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c14419-0eca-4ba4-ab76-07f30b383a88 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:06:46.013092 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 417/846] 10.222.0.136 () {56 vars in 1114 bytes} [Thu Jul 14 17:06:45 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 17:06:46.020758 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6926ddb-4d43-4aff-974d-a280dca8653f None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:06:46.126842 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:06:46.139389 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6926ddb-4d43-4aff-974d-a280dca8653f None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:06:46.177572 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82115d18-99ba-44f5-856f-093541ac6291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:06:46.178477 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82115d18-99ba-44f5-856f-093541ac6291 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:06:46.178730 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82115d18-99ba-44f5-856f-093541ac6291 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:06:46.179096 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82115d18-99ba-44f5-856f-093541ac6291 None admin] PATH_INFO: `/v3/users/placement` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:06:46.187428 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82115d18-99ba-44f5-856f-093541ac6291 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:06:46.189011 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82115d18-99ba-44f5-856f-093541ac6291 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:06:46.205821 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-82115d18-99ba-44f5-856f-093541ac6291 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 14 17:06:46.205821 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:06:46.205821 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:06:46.205821 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:06:46.205821 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:06:46.205821 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:06:46.205821 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:06:46.205821 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:06:46.205821 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:06:46.205821 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:06:46.205821 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:06:46.205821 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:06:46.205821 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 17:06:46.205821 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 17:06:46.205821 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 17:06:46.205821 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 17:06:46.207060 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:06:46.207060 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:06:46.207060 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 17:06:46.207060 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 17:06:46.207060 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 17:06:46.207060 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 17:06:46.207060 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:06:46.207060 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:06:46.207060 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:06:46.207060 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:06:46.207060 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:06:46.207060 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Jul 14 17:06:46.207060 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:06:46.207060 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:06:46.207060 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:06:46.207060 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:06:46.207060 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:06:46.207060 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:06:46.208351 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:06:46.208351 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:06:46.208351 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 17:06:46.208351 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 17:06:46.208351 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 17:06:46.208351 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 17:06:46.208351 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 17:06:46.208351 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 17:06:46.208351 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 14 17:06:46.208351 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Jul 14 17:06:46.214459 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 430/847] 10.222.0.136 () {56 vars in 1113 bytes} [Thu Jul 14 17:06:46 2022] GET /identity/v3/users/placement => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:06:46.215687 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c14419-0eca-4ba4-ab76-07f30b383a88 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:06:46.269739 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:06:46.325967 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c14419-0eca-4ba4-ab76-07f30b383a88 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:06:46.365624 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a5c6e6-d566-4d64-aad1-5f83331164b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:06:46.366470 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a5c6e6-d566-4d64-aad1-5f83331164b0 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:06:46.366770 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a5c6e6-d566-4d64-aad1-5f83331164b0 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:06:46.367078 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a5c6e6-d566-4d64-aad1-5f83331164b0 None admin] PATH_INFO: `/v3/users` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:06:46.368070 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a5c6e6-d566-4d64-aad1-5f83331164b0 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:06:46.368424 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a5c6e6-d566-4d64-aad1-5f83331164b0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:06:46.370105 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a5c6e6-d566-4d64-aad1-5f83331164b0 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:06:46.392416 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 418/848] 10.222.0.136 () {56 vars in 1148 bytes} [Thu Jul 14 17:06:46 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 380 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:06:46.404250 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82115d18-99ba-44f5-856f-093541ac6291 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:06:46.536330 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82115d18-99ba-44f5-856f-093541ac6291 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:06:46.579758 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216fdf9c-02c5-4458-9e02-257beb9f30fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:06:46.580768 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216fdf9c-02c5-4458-9e02-257beb9f30fc None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:06:46.581179 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216fdf9c-02c5-4458-9e02-257beb9f30fc None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:06:46.581707 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216fdf9c-02c5-4458-9e02-257beb9f30fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:06:46.595359 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216fdf9c-02c5-4458-9e02-257beb9f30fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:06:46.596923 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216fdf9c-02c5-4458-9e02-257beb9f30fc None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:06:46.616406 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-216fdf9c-02c5-4458-9e02-257beb9f30fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:06:46.616406 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:06:46.616406 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:06:46.616406 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:06:46.616406 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:06:46.616406 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:06:46.616406 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:06:46.616406 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:06:46.616406 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:06:46.616406 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:06:46.616406 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:06:46.616406 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:06:46.616406 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 17:06:46.616406 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 17:06:46.616406 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 17:06:46.617567 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 17:06:46.617567 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:06:46.617567 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:06:46.617567 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:06:46.617567 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:06:46.617567 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:06:46.617567 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:06:46.617567 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:06:46.617567 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Jul 14 17:06:46.617567 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:06:46.617567 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:06:46.617567 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:06:46.617567 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:06:46.617567 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:06:46.617567 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:06:46.617567 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:06:46.617567 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:06:46.618770 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 17:06:46.618770 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 17:06:46.618770 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:06:46.618770 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Jul 14 17:06:46.618770 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 431/849] 10.222.0.136 () {56 vars in 1113 bytes} [Thu Jul 14 17:06:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 17:06:46.623950 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a5c6e6-d566-4d64-aad1-5f83331164b0 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:06:46.740399 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a5c6e6-d566-4d64-aad1-5f83331164b0 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:06:46.742971 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:06:46.786277 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acd9694-f5b1-4012-8aa5-d412bfa05133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:06:46.787032 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acd9694-f5b1-4012-8aa5-d412bfa05133 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:06:46.787307 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acd9694-f5b1-4012-8aa5-d412bfa05133 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:06:46.787582 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acd9694-f5b1-4012-8aa5-d412bfa05133 None admin] PATH_INFO: `/v3/domains` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:06:46.788345 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acd9694-f5b1-4012-8aa5-d412bfa05133 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:06:46.788687 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acd9694-f5b1-4012-8aa5-d412bfa05133 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:06:46.790597 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acd9694-f5b1-4012-8aa5-d412bfa05133 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:06:46.804197 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 419/850] 10.222.0.136 () {56 vars in 1114 bytes} [Thu Jul 14 17:06:46 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 17:06:46.810121 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216fdf9c-02c5-4458-9e02-257beb9f30fc None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:06:46.814393 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:06:46.928709 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216fdf9c-02c5-4458-9e02-257beb9f30fc None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:06:46.974053 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa16355-a65a-4a4e-b9bc-5b79c6d5ecba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:06:46.975192 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa16355-a65a-4a4e-b9bc-5b79c6d5ecba None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:06:46.975490 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa16355-a65a-4a4e-b9bc-5b79c6d5ecba None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:06:46.975775 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa16355-a65a-4a4e-b9bc-5b79c6d5ecba None admin] PATH_INFO: `/v3/projects/service` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:06:46.983574 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa16355-a65a-4a4e-b9bc-5b79c6d5ecba None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:06:46.985777 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa16355-a65a-4a4e-b9bc-5b79c6d5ecba None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:06:47.001893 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-aaa16355-a65a-4a4e-b9bc-5b79c6d5ecba None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 17:06:47.001893 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:06:47.001893 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:06:47.001893 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:06:47.001893 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:06:47.001893 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:06:47.001893 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:06:47.001893 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:06:47.001893 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:06:47.001893 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:06:47.001893 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:06:47.001893 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:06:47.001893 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 17:06:47.001893 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 17:06:47.001893 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 17:06:47.002993 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 17:06:47.002993 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:06:47.002993 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:06:47.002993 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:06:47.002993 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:06:47.002993 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:06:47.002993 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:06:47.002993 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:06:47.002993 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Jul 14 17:06:47.002993 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:06:47.002993 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:06:47.002993 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:06:47.002993 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:06:47.002993 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:06:47.002993 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:06:47.002993 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:06:47.002993 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:06:47.008884 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 17:06:47.008884 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 17:06:47.008884 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 17:06:47.008884 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 17:06:47.008884 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 17:06:47.008884 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 17:06:47.008884 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 17:06:47.008884 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Jul 14 17:06:47.008884 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 432/851] 10.222.0.136 () {56 vars in 1116 bytes} [Thu Jul 14 17:06:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:06:47.009476 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acd9694-f5b1-4012-8aa5-d412bfa05133 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:06:47.125892 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acd9694-f5b1-4012-8aa5-d412bfa05133 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:06:47.169471 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a2c8cd-cd94-4304-a0a0-b5e3e3c0e4e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:06:47.170170 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a2c8cd-cd94-4304-a0a0-b5e3e3c0e4e0 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:06:47.170464 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a2c8cd-cd94-4304-a0a0-b5e3e3c0e4e0 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:06:47.170751 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a2c8cd-cd94-4304-a0a0-b5e3e3c0e4e0 None admin] PATH_INFO: `/v3/projects` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:06:47.171946 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a2c8cd-cd94-4304-a0a0-b5e3e3c0e4e0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:06:47.172358 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a2c8cd-cd94-4304-a0a0-b5e3e3c0e4e0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:06:47.174699 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a2c8cd-cd94-4304-a0a0-b5e3e3c0e4e0 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:06:47.195297 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 420/852] 10.222.0.136 () {56 vars in 1153 bytes} [Thu Jul 14 17:06:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 17:06:47.198698 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa16355-a65a-4a4e-b9bc-5b79c6d5ecba None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:06:47.270342 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:06:47.314379 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa16355-a65a-4a4e-b9bc-5b79c6d5ecba None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:06:47.350720 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6763c75d-175b-442f-9f03-f4b86ca705b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:06:47.351837 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6763c75d-175b-442f-9f03-f4b86ca705b1 None admin] REQUEST_METHOD: `PUT` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:06:47.352135 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6763c75d-175b-442f-9f03-f4b86ca705b1 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:06:47.352454 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6763c75d-175b-442f-9f03-f4b86ca705b1 None admin] PATH_INFO: `/v3/projects/d57eaa6dbca24cbb99dce1fe3437ecae/users/05cdf81bd7d14730962816677457e858/roles/5e0ec7345cc84921907ca95b801a656b` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:06:47.369155 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6763c75d-175b-442f-9f03-f4b86ca705b1 None admin] RBAC: Authorizing `identity:create_grant(project_id=d57eaa6dbca24cbb99dce1fe3437ecae, user_id=05cdf81bd7d14730962816677457e858, role_id=5e0ec7345cc84921907ca95b801a656b)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:06:47.370638 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6763c75d-175b-442f-9f03-f4b86ca705b1 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:06:47.383953 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 433/853] 10.222.0.136 () {58 vars in 1444 bytes} [Thu Jul 14 17:06:47 2022] PUT /identity/v3/projects/d57eaa6dbca24cbb99dce1fe3437ecae/users/05cdf81bd7d14730962816677457e858/roles/5e0ec7345cc84921907ca95b801a656b => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:06:49.949087 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465097df-ce62-4176-92e4-facb5643d35d None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:06:49.949723 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465097df-ce62-4176-92e4-facb5643d35d None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:06:49.949723 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465097df-ce62-4176-92e4-facb5643d35d None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:06:49.951672 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 421/854] 10.222.0.136 () {54 vars in 931 bytes} [Thu Jul 14 17:06:49 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:06:49.964045 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31441afb-57cd-4ec2-a7d4-fb32366fa2ad None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:06:49.964539 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31441afb-57cd-4ec2-a7d4-fb32366fa2ad None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:06:49.964883 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31441afb-57cd-4ec2-a7d4-fb32366fa2ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:06:49.984358 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-31441afb-57cd-4ec2-a7d4-fb32366fa2ad None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:06:49.985598 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-31441afb-57cd-4ec2-a7d4-fb32366fa2ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:06:50.058561 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 434/855] 10.222.0.136 () {58 vars in 1028 bytes} [Thu Jul 14 17:06:49 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 17:06:50.085133 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465097df-ce62-4176-92e4-facb5643d35d None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:06:50.116636 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:06:50.220049 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465097df-ce62-4176-92e4-facb5643d35d None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:06:50.259391 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d8f3bc-057a-4066-8823-1c99e6d18372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:06:50.260230 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d8f3bc-057a-4066-8823-1c99e6d18372 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:06:50.260525 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d8f3bc-057a-4066-8823-1c99e6d18372 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:06:50.260804 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d8f3bc-057a-4066-8823-1c99e6d18372 None admin] PATH_INFO: `/v3/roles/service` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:06:50.271887 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d8f3bc-057a-4066-8823-1c99e6d18372 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 17:06:50.279563 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-a2d8f3bc-057a-4066-8823-1c99e6d18372 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 17:06:50.279563 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:06:50.279563 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:06:50.279563 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:06:50.279563 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:06:50.279563 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:06:50.279563 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:06:50.279563 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:06:50.279563 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:06:50.279563 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:06:50.279563 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:06:50.279563 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:06:50.279563 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 17:06:50.279563 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 17:06:50.279563 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 17:06:50.279563 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 17:06:50.280713 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 17:06:50.280713 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 17:06:50.280713 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 17:06:50.280713 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 17:06:50.280713 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:06:50.280713 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:06:50.280713 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:06:50.280713 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:06:50.280713 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:06:50.280713 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:06:50.280713 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:06:50.280713 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Jul 14 17:06:50.280713 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:06:50.280713 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:06:50.280713 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:06:50.280713 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:06:50.282162 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:06:50.282162 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:06:50.282162 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:06:50.282162 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:06:50.282162 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 17:06:50.282162 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 17:06:50.282162 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 17:06:50.282162 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 17:06:50.282162 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 17:06:50.282162 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 17:06:50.282162 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 17:06:50.282162 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Jul 14 17:06:50.282162 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 422/856] 10.222.0.136 () {56 vars in 1107 bytes} [Thu Jul 14 17:06:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 17:06:50.287109 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31441afb-57cd-4ec2-a7d4-fb32366fa2ad None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:06:50.336299 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:06:50.406908 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31441afb-57cd-4ec2-a7d4-fb32366fa2ad None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:06:50.447446 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29883694-c346-4b76-8768-9036548eec49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:06:50.448270 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29883694-c346-4b76-8768-9036548eec49 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:06:50.448671 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29883694-c346-4b76-8768-9036548eec49 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:06:50.449068 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29883694-c346-4b76-8768-9036548eec49 None admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:06:50.450035 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29883694-c346-4b76-8768-9036548eec49 None admin] RBAC: Adding query filter params (name=service) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:06:50.450404 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29883694-c346-4b76-8768-9036548eec49 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:06:50.452021 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29883694-c346-4b76-8768-9036548eec49 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:06:50.468227 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 435/857] 10.222.0.136 () {56 vars in 1108 bytes} [Thu Jul 14 17:06:50 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:06:50.469587 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d8f3bc-057a-4066-8823-1c99e6d18372 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:06:50.568975 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:06:50.588974 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d8f3bc-057a-4066-8823-1c99e6d18372 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:06:50.635227 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d247cb44-3d37-4e75-9408-00540d482296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:06:50.636135 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d247cb44-3d37-4e75-9408-00540d482296 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:06:50.636424 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d247cb44-3d37-4e75-9408-00540d482296 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:06:50.636713 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d247cb44-3d37-4e75-9408-00540d482296 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:06:50.648593 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d247cb44-3d37-4e75-9408-00540d482296 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:06:50.650099 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d247cb44-3d37-4e75-9408-00540d482296 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:06:50.667441 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-d247cb44-3d37-4e75-9408-00540d482296 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:06:50.667441 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:06:50.667441 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:06:50.667441 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:06:50.667441 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:06:50.667441 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:06:50.667441 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:06:50.667441 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:06:50.667441 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:06:50.667441 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:06:50.667441 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:06:50.667441 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:06:50.667441 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 17:06:50.667441 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 17:06:50.667441 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 17:06:50.668535 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 17:06:50.668535 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:06:50.668535 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:06:50.668535 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:06:50.668535 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:06:50.668535 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:06:50.668535 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:06:50.668535 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:06:50.668535 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Jul 14 17:06:50.668535 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:06:50.668535 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:06:50.668535 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:06:50.668535 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:06:50.668535 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:06:50.668535 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:06:50.668535 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:06:50.668535 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:06:50.669521 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 17:06:50.669521 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 17:06:50.669521 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:06:50.669521 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Jul 14 17:06:50.669521 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 423/858] 10.222.0.136 () {56 vars in 1113 bytes} [Thu Jul 14 17:06:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:06:50.674961 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29883694-c346-4b76-8768-9036548eec49 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:06:50.787906 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29883694-c346-4b76-8768-9036548eec49 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:06:50.790534 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:06:50.831059 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfec2a2-9126-47a7-9deb-9f55a4f82a62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:06:50.831830 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfec2a2-9126-47a7-9deb-9f55a4f82a62 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:06:50.832126 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfec2a2-9126-47a7-9deb-9f55a4f82a62 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:06:50.832498 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfec2a2-9126-47a7-9deb-9f55a4f82a62 None admin] PATH_INFO: `/v3/domains` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:06:50.833305 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfec2a2-9126-47a7-9deb-9f55a4f82a62 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:06:50.833721 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfec2a2-9126-47a7-9deb-9f55a4f82a62 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:06:50.835179 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfec2a2-9126-47a7-9deb-9f55a4f82a62 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:06:50.849149 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 436/859] 10.222.0.136 () {56 vars in 1114 bytes} [Thu Jul 14 17:06:50 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:06:50.855945 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d247cb44-3d37-4e75-9408-00540d482296 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:06:50.976789 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d247cb44-3d37-4e75-9408-00540d482296 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:06:51.017583 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8787de-b909-4a5d-a848-47838de96504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:06:51.018488 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8787de-b909-4a5d-a848-47838de96504 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:06:51.018831 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8787de-b909-4a5d-a848-47838de96504 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:06:51.019230 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8787de-b909-4a5d-a848-47838de96504 None admin] PATH_INFO: `/v3/users/placement` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:06:51.022682 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:06:51.028664 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8787de-b909-4a5d-a848-47838de96504 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:06:51.030530 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8787de-b909-4a5d-a848-47838de96504 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:06:51.048866 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-cf8787de-b909-4a5d-a848-47838de96504 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 14 17:06:51.048866 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:06:51.048866 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:06:51.048866 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:06:51.048866 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:06:51.048866 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:06:51.048866 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:06:51.048866 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:06:51.048866 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:06:51.048866 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:06:51.048866 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:06:51.048866 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:06:51.048866 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 17:06:51.048866 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 17:06:51.048866 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 17:06:51.048866 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 17:06:51.050134 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:06:51.050134 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:06:51.050134 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 17:06:51.050134 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 17:06:51.050134 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 17:06:51.050134 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 17:06:51.050134 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:06:51.050134 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:06:51.050134 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:06:51.050134 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:06:51.050134 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:06:51.050134 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Jul 14 17:06:51.050134 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:06:51.050134 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:06:51.050134 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:06:51.050134 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:06:51.050134 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:06:51.050134 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:06:51.051319 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:06:51.051319 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:06:51.051319 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 17:06:51.051319 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 17:06:51.051319 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 17:06:51.051319 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 17:06:51.051319 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 17:06:51.051319 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 17:06:51.051319 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 14 17:06:51.051319 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Jul 14 17:06:51.051319 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 424/860] 10.222.0.136 () {56 vars in 1113 bytes} [Thu Jul 14 17:06:50 2022] GET /identity/v3/users/placement => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:06:51.056343 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfec2a2-9126-47a7-9deb-9f55a4f82a62 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:06:51.171434 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfec2a2-9126-47a7-9deb-9f55a4f82a62 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:06:51.212567 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373688e5-9ab6-4bda-8ca4-f0d372a80936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:06:51.213371 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373688e5-9ab6-4bda-8ca4-f0d372a80936 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:06:51.213760 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373688e5-9ab6-4bda-8ca4-f0d372a80936 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:06:51.214084 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373688e5-9ab6-4bda-8ca4-f0d372a80936 None admin] PATH_INFO: `/v3/users` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:06:51.215026 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373688e5-9ab6-4bda-8ca4-f0d372a80936 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:06:51.215310 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373688e5-9ab6-4bda-8ca4-f0d372a80936 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:06:51.216848 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373688e5-9ab6-4bda-8ca4-f0d372a80936 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:06:51.236605 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 437/861] 10.222.0.136 () {56 vars in 1148 bytes} [Thu Jul 14 17:06:51 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 380 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:06:51.243079 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8787de-b909-4a5d-a848-47838de96504 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:06:51.366778 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8787de-b909-4a5d-a848-47838de96504 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:06:51.402595 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e925bd1e-807c-400c-aa68-9856b9153e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:06:51.403222 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e925bd1e-807c-400c-aa68-9856b9153e7d None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:06:51.403551 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e925bd1e-807c-400c-aa68-9856b9153e7d None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:06:51.403840 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e925bd1e-807c-400c-aa68-9856b9153e7d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:06:51.476349 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:06:51.484694 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e925bd1e-807c-400c-aa68-9856b9153e7d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:06:51.486255 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e925bd1e-807c-400c-aa68-9856b9153e7d None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:06:51.600853 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 425/862] 10.222.0.136 () {58 vars in 1287 bytes} [Thu Jul 14 17:06:51 2022] GET /identity/v3/auth/tokens => generated 1863 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 17:06:51.607347 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373688e5-9ab6-4bda-8ca4-f0d372a80936 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:06:51.637920 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:06:51.729384 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373688e5-9ab6-4bda-8ca4-f0d372a80936 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:06:51.765679 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d87d042-8ab2-4d7e-8969-9cda83622865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:06:51.766508 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d87d042-8ab2-4d7e-8969-9cda83622865 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:06:51.766738 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d87d042-8ab2-4d7e-8969-9cda83622865 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:06:51.767011 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d87d042-8ab2-4d7e-8969-9cda83622865 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:06:51.779045 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d87d042-8ab2-4d7e-8969-9cda83622865 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:06:51.781256 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d87d042-8ab2-4d7e-8969-9cda83622865 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:06:51.802608 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-4d87d042-8ab2-4d7e-8969-9cda83622865 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:06:51.802608 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:06:51.802608 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:06:51.802608 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:06:51.802608 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:06:51.802608 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:06:51.802608 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:06:51.802608 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:06:51.802608 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:06:51.802608 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:06:51.802608 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:06:51.802608 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:06:51.802608 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 17:06:51.802608 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 17:06:51.802608 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 17:06:51.803662 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 17:06:51.803662 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:06:51.803662 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:06:51.803662 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:06:51.803662 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:06:51.803662 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:06:51.803662 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:06:51.803662 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:06:51.803662 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Jul 14 17:06:51.803662 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:06:51.803662 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:06:51.803662 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:06:51.803662 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:06:51.803662 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:06:51.803662 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:06:51.803662 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:06:51.803662 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:06:51.804554 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 17:06:51.804554 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 17:06:51.804554 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:06:51.804554 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Jul 14 17:06:51.804554 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 438/863] 10.222.0.136 () {56 vars in 1113 bytes} [Thu Jul 14 17:06:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 17:06:51.810201 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e925bd1e-807c-400c-aa68-9856b9153e7d None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:06:51.930544 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:06:51.937162 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e925bd1e-807c-400c-aa68-9856b9153e7d None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:06:51.975722 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b1ca41-7735-494a-83a8-c2f429c25de7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:06:51.976398 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b1ca41-7735-494a-83a8-c2f429c25de7 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:06:51.976678 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b1ca41-7735-494a-83a8-c2f429c25de7 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:06:51.976957 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b1ca41-7735-494a-83a8-c2f429c25de7 None admin] PATH_INFO: `/v3/domains` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:06:51.977974 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b1ca41-7735-494a-83a8-c2f429c25de7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:06:51.978304 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b1ca41-7735-494a-83a8-c2f429c25de7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:06:51.979657 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b1ca41-7735-494a-83a8-c2f429c25de7 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:06:51.991739 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 426/864] 10.222.0.136 () {56 vars in 1114 bytes} [Thu Jul 14 17:06:51 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:06:51.997715 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d87d042-8ab2-4d7e-8969-9cda83622865 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:06:52.089049 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:06:52.118495 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d87d042-8ab2-4d7e-8969-9cda83622865 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:06:52.159875 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297523bc-11c1-49ae-9b97-8c12ede4b06f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:06:52.160836 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297523bc-11c1-49ae-9b97-8c12ede4b06f None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:06:52.161207 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297523bc-11c1-49ae-9b97-8c12ede4b06f None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:06:52.161513 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297523bc-11c1-49ae-9b97-8c12ede4b06f None admin] PATH_INFO: `/v3/projects/service` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:06:52.168885 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297523bc-11c1-49ae-9b97-8c12ede4b06f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:06:52.170391 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297523bc-11c1-49ae-9b97-8c12ede4b06f None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:06:52.187030 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-297523bc-11c1-49ae-9b97-8c12ede4b06f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 17:06:52.187030 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:06:52.187030 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:06:52.187030 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:06:52.187030 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:06:52.187030 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:06:52.187030 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:06:52.187030 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:06:52.187030 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:06:52.187030 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:06:52.187030 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:06:52.187030 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:06:52.187030 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 17:06:52.187030 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 17:06:52.187030 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 17:06:52.188252 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 17:06:52.188252 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:06:52.188252 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:06:52.188252 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:06:52.188252 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:06:52.188252 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:06:52.188252 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:06:52.188252 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:06:52.188252 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Jul 14 17:06:52.188252 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:06:52.188252 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:06:52.188252 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:06:52.188252 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:06:52.188252 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:06:52.188252 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:06:52.188252 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:06:52.188252 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:06:52.189366 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 17:06:52.189366 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 17:06:52.189366 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 17:06:52.189366 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 17:06:52.189366 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 17:06:52.189366 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 17:06:52.189366 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 17:06:52.189366 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Jul 14 17:06:52.191035 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 439/865] 10.222.0.136 () {56 vars in 1116 bytes} [Thu Jul 14 17:06:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:06:52.197164 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b1ca41-7735-494a-83a8-c2f429c25de7 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:06:52.317461 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b1ca41-7735-494a-83a8-c2f429c25de7 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:06:52.366905 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37696a0a-2144-4fc8-a3f9-b72190d8ff05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:06:52.367842 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37696a0a-2144-4fc8-a3f9-b72190d8ff05 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:06:52.368285 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37696a0a-2144-4fc8-a3f9-b72190d8ff05 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:06:52.368697 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37696a0a-2144-4fc8-a3f9-b72190d8ff05 None admin] PATH_INFO: `/v3/projects` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:06:52.369756 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37696a0a-2144-4fc8-a3f9-b72190d8ff05 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:06:52.370278 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37696a0a-2144-4fc8-a3f9-b72190d8ff05 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:06:52.372475 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37696a0a-2144-4fc8-a3f9-b72190d8ff05 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:06:52.397835 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 427/866] 10.222.0.136 () {56 vars in 1153 bytes} [Thu Jul 14 17:06:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:06:52.399311 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297523bc-11c1-49ae-9b97-8c12ede4b06f None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:06:52.520530 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297523bc-11c1-49ae-9b97-8c12ede4b06f None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:06:52.557496 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bdff2a-4e77-44cf-8c2d-75b854cfa3de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:06:52.558323 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bdff2a-4e77-44cf-8c2d-75b854cfa3de None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:06:52.558663 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bdff2a-4e77-44cf-8c2d-75b854cfa3de None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:06:52.559010 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bdff2a-4e77-44cf-8c2d-75b854cfa3de None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:06:52.559927 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bdff2a-4e77-44cf-8c2d-75b854cfa3de None admin] RBAC: Adding query filter params (role.id=5e0ec7345cc84921907ca95b801a656b, scope.project.id=d57eaa6dbca24cbb99dce1fe3437ecae, user.id=05cdf81bd7d14730962816677457e858) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:06:52.560333 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bdff2a-4e77-44cf-8c2d-75b854cfa3de None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:06:52.562436 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bdff2a-4e77-44cf-8c2d-75b854cfa3de None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:06:52.564614 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:06:52.570425 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 440/867] 10.222.0.136 () {56 vars in 1379 bytes} [Thu Jul 14 17:06:52 2022] GET /identity/v3/role_assignments?user.id=05cdf81bd7d14730962816677457e858&scope.project.id=d57eaa6dbca24cbb99dce1fe3437ecae&role.id=5e0ec7345cc84921907ca95b801a656b => generated 610 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:06:55.413782 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2d64ef-9aa5-4c18-af7c-db030dabd0b7 None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:06:55.414330 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2d64ef-9aa5-4c18-af7c-db030dabd0b7 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:06:55.414330 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2d64ef-9aa5-4c18-af7c-db030dabd0b7 None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:06:55.415691 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 428/868] 10.222.0.136 () {54 vars in 931 bytes} [Thu Jul 14 17:06:55 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:06:55.423267 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d95d95-c066-4a63-af90-ea814ce8467b None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:06:55.423764 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d95d95-c066-4a63-af90-ea814ce8467b None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:06:55.424082 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d95d95-c066-4a63-af90-ea814ce8467b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:06:55.442404 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-45d95d95-c066-4a63-af90-ea814ce8467b None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:06:55.443775 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-45d95d95-c066-4a63-af90-ea814ce8467b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:06:55.521593 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 441/869] 10.222.0.136 () {58 vars in 1028 bytes} [Thu Jul 14 17:06:55 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 17:06:55.548087 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2d64ef-9aa5-4c18-af7c-db030dabd0b7 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:06:55.571134 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:06:55.674673 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2d64ef-9aa5-4c18-af7c-db030dabd0b7 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:06:55.714806 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f34eac-49b2-4d40-bc7d-c3dc4c7a39bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:06:55.715695 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f34eac-49b2-4d40-bc7d-c3dc4c7a39bc None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:06:55.716190 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f34eac-49b2-4d40-bc7d-c3dc4c7a39bc None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:06:55.716513 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f34eac-49b2-4d40-bc7d-c3dc4c7a39bc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:06:55.729579 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f34eac-49b2-4d40-bc7d-c3dc4c7a39bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 17:06:55.737764 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-d9f34eac-49b2-4d40-bc7d-c3dc4c7a39bc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 17:06:55.737764 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:06:55.737764 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:06:55.737764 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:06:55.737764 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:06:55.737764 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:06:55.737764 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:06:55.737764 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:06:55.737764 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:06:55.737764 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:06:55.737764 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:06:55.737764 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:06:55.737764 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 17:06:55.737764 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 17:06:55.737764 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 17:06:55.737764 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 17:06:55.738899 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 17:06:55.738899 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 17:06:55.738899 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 17:06:55.738899 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 17:06:55.738899 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:06:55.738899 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:06:55.738899 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:06:55.738899 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:06:55.738899 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:06:55.738899 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:06:55.738899 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:06:55.738899 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Jul 14 17:06:55.738899 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:06:55.738899 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:06:55.738899 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:06:55.738899 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:06:55.739755 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:06:55.739755 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:06:55.739755 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:06:55.739755 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:06:55.739755 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 17:06:55.739755 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 17:06:55.739755 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 17:06:55.739755 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 17:06:55.739755 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 17:06:55.739755 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 17:06:55.739755 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 17:06:55.739755 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Jul 14 17:06:55.739755 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 429/870] 10.222.0.136 () {56 vars in 1101 bytes} [Thu Jul 14 17:06:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:06:55.746166 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d95d95-c066-4a63-af90-ea814ce8467b None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:06:55.868478 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d95d95-c066-4a63-af90-ea814ce8467b None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:06:55.896718 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:06:55.904865 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b0ec8a-f9c8-45be-85cd-01a49a7a5338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:06:55.905759 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b0ec8a-f9c8-45be-85cd-01a49a7a5338 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:06:55.905979 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b0ec8a-f9c8-45be-85cd-01a49a7a5338 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:06:55.906241 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b0ec8a-f9c8-45be-85cd-01a49a7a5338 None admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:06:55.906998 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b0ec8a-f9c8-45be-85cd-01a49a7a5338 None admin] RBAC: Adding query filter params (name=admin) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:06:55.907312 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b0ec8a-f9c8-45be-85cd-01a49a7a5338 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:06:55.908672 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b0ec8a-f9c8-45be-85cd-01a49a7a5338 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:06:55.917424 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 442/871] 10.222.0.136 () {56 vars in 1104 bytes} [Thu Jul 14 17:06:55 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:06:55.923841 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f34eac-49b2-4d40-bc7d-c3dc4c7a39bc None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:06:56.007275 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:06:56.035473 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f34eac-49b2-4d40-bc7d-c3dc4c7a39bc None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:06:56.075108 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651d40a3-4bcf-46b7-9508-db6548d0eba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:06:56.075919 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651d40a3-4bcf-46b7-9508-db6548d0eba4 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:06:56.076239 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651d40a3-4bcf-46b7-9508-db6548d0eba4 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:06:56.076524 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651d40a3-4bcf-46b7-9508-db6548d0eba4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:06:56.088867 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651d40a3-4bcf-46b7-9508-db6548d0eba4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:06:56.090371 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651d40a3-4bcf-46b7-9508-db6548d0eba4 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:06:56.109462 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-651d40a3-4bcf-46b7-9508-db6548d0eba4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:06:56.109462 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:06:56.109462 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:06:56.109462 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:06:56.109462 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:06:56.109462 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:06:56.109462 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:06:56.109462 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:06:56.109462 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:06:56.109462 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:06:56.109462 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:06:56.109462 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:06:56.109462 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 17:06:56.109462 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 17:06:56.109462 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 17:06:56.110642 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 17:06:56.110642 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:06:56.110642 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:06:56.110642 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:06:56.110642 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:06:56.110642 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:06:56.110642 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:06:56.110642 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:06:56.110642 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Jul 14 17:06:56.110642 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:06:56.110642 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:06:56.110642 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:06:56.110642 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:06:56.110642 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:06:56.110642 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:06:56.110642 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:06:56.110642 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:06:56.111608 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 17:06:56.111608 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 17:06:56.111608 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:06:56.111608 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Jul 14 17:06:56.111608 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 430/872] 10.222.0.136 () {56 vars in 1113 bytes} [Thu Jul 14 17:06:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:06:56.117071 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b0ec8a-f9c8-45be-85cd-01a49a7a5338 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:06:56.239473 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b0ec8a-f9c8-45be-85cd-01a49a7a5338 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:06:56.274326 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e53cc64-ab62-4370-bf31-e54585c5731a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:06:56.274981 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e53cc64-ab62-4370-bf31-e54585c5731a None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:06:56.275266 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e53cc64-ab62-4370-bf31-e54585c5731a None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:06:56.275539 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e53cc64-ab62-4370-bf31-e54585c5731a None admin] PATH_INFO: `/v3/domains` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:06:56.276254 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e53cc64-ab62-4370-bf31-e54585c5731a None admin] RBAC: Adding query filter params (name=Default) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:06:56.276561 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e53cc64-ab62-4370-bf31-e54585c5731a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:06:56.277937 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e53cc64-ab62-4370-bf31-e54585c5731a None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:06:56.290379 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 443/873] 10.222.0.136 () {56 vars in 1114 bytes} [Thu Jul 14 17:06:56 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:06:56.297959 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651d40a3-4bcf-46b7-9508-db6548d0eba4 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:06:56.425518 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651d40a3-4bcf-46b7-9508-db6548d0eba4 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:06:56.456369 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:06:56.465786 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9605eef-9c29-4602-a295-fe08e7dd4934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:06:56.466553 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9605eef-9c29-4602-a295-fe08e7dd4934 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:06:56.466836 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9605eef-9c29-4602-a295-fe08e7dd4934 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:06:56.467119 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9605eef-9c29-4602-a295-fe08e7dd4934 None admin] PATH_INFO: `/v3/users/placement` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:06:56.476102 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9605eef-9c29-4602-a295-fe08e7dd4934 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:06:56.478083 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9605eef-9c29-4602-a295-fe08e7dd4934 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:06:56.495231 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-d9605eef-9c29-4602-a295-fe08e7dd4934 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 14 17:06:56.495231 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:06:56.495231 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:06:56.495231 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:06:56.495231 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:06:56.495231 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:06:56.495231 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:06:56.495231 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:06:56.495231 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:06:56.495231 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:06:56.495231 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:06:56.495231 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:06:56.495231 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 17:06:56.495231 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 17:06:56.495231 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 17:06:56.495231 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 17:06:56.496420 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:06:56.496420 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:06:56.496420 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 17:06:56.496420 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 17:06:56.496420 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 17:06:56.496420 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 17:06:56.496420 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:06:56.496420 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:06:56.496420 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:06:56.496420 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:06:56.496420 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:06:56.496420 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Jul 14 17:06:56.496420 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:06:56.496420 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:06:56.496420 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:06:56.496420 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:06:56.496420 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:06:56.496420 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:06:56.497522 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:06:56.497522 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:06:56.497522 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 17:06:56.497522 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 17:06:56.497522 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 17:06:56.497522 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 17:06:56.497522 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 17:06:56.497522 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 17:06:56.497522 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 14 17:06:56.497522 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Jul 14 17:06:56.497522 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 431/874] 10.222.0.136 () {56 vars in 1113 bytes} [Thu Jul 14 17:06:56 2022] GET /identity/v3/users/placement => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:06:56.504135 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e53cc64-ab62-4370-bf31-e54585c5731a None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:06:56.559027 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:06:56.613085 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e53cc64-ab62-4370-bf31-e54585c5731a None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:06:56.652723 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bef5c5-0dad-48f4-82fd-cbf87740a1c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:06:56.653378 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bef5c5-0dad-48f4-82fd-cbf87740a1c7 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:06:56.653691 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bef5c5-0dad-48f4-82fd-cbf87740a1c7 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:06:56.654038 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bef5c5-0dad-48f4-82fd-cbf87740a1c7 None admin] PATH_INFO: `/v3/users` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:06:56.654870 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bef5c5-0dad-48f4-82fd-cbf87740a1c7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:06:56.655265 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bef5c5-0dad-48f4-82fd-cbf87740a1c7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:06:56.656652 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bef5c5-0dad-48f4-82fd-cbf87740a1c7 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:06:56.674869 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 444/875] 10.222.0.136 () {56 vars in 1148 bytes} [Thu Jul 14 17:06:56 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 380 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:06:56.681997 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9605eef-9c29-4602-a295-fe08e7dd4934 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:06:56.803522 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9605eef-9c29-4602-a295-fe08e7dd4934 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:06:56.850903 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e09fc4-b0c8-4c3d-9ea4-500d0c8b1d17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:06:56.851776 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e09fc4-b0c8-4c3d-9ea4-500d0c8b1d17 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:06:56.852070 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e09fc4-b0c8-4c3d-9ea4-500d0c8b1d17 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:06:56.852653 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e09fc4-b0c8-4c3d-9ea4-500d0c8b1d17 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:06:56.922656 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:06:56.935708 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e09fc4-b0c8-4c3d-9ea4-500d0c8b1d17 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:06:56.937985 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e09fc4-b0c8-4c3d-9ea4-500d0c8b1d17 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:06:57.042892 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 432/876] 10.222.0.136 () {58 vars in 1287 bytes} [Thu Jul 14 17:06:56 2022] GET /identity/v3/auth/tokens => generated 1863 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 17:06:57.049773 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bef5c5-0dad-48f4-82fd-cbf87740a1c7 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:06:57.158886 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bef5c5-0dad-48f4-82fd-cbf87740a1c7 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:06:57.169098 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:06:57.200214 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd32c054-a1e5-43c1-a3f7-380b91e9f73a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:06:57.201015 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd32c054-a1e5-43c1-a3f7-380b91e9f73a None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:06:57.201299 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd32c054-a1e5-43c1-a3f7-380b91e9f73a None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:06:57.201626 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd32c054-a1e5-43c1-a3f7-380b91e9f73a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:06:57.212554 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd32c054-a1e5-43c1-a3f7-380b91e9f73a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:06:57.214051 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd32c054-a1e5-43c1-a3f7-380b91e9f73a None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:06:57.235660 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-dd32c054-a1e5-43c1-a3f7-380b91e9f73a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:06:57.235660 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:06:57.235660 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:06:57.235660 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:06:57.235660 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:06:57.235660 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:06:57.235660 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:06:57.235660 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:06:57.235660 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:06:57.235660 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:06:57.235660 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:06:57.235660 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:06:57.235660 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 17:06:57.235660 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 17:06:57.235660 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 17:06:57.236616 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 17:06:57.236616 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:06:57.236616 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:06:57.236616 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:06:57.236616 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:06:57.236616 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:06:57.236616 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:06:57.236616 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:06:57.236616 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Jul 14 17:06:57.236616 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:06:57.236616 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:06:57.236616 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:06:57.236616 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:06:57.236616 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:06:57.236616 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:06:57.236616 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:06:57.236616 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:06:57.237741 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 17:06:57.237741 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 17:06:57.237741 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:06:57.237741 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Jul 14 17:06:57.237741 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 445/877] 10.222.0.136 () {56 vars in 1113 bytes} [Thu Jul 14 17:06:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:06:57.243581 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e09fc4-b0c8-4c3d-9ea4-500d0c8b1d17 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:06:57.335613 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:06:57.349130 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e09fc4-b0c8-4c3d-9ea4-500d0c8b1d17 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:06:57.384019 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da446eb-6035-4b52-9d03-4825be85fc0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:06:57.384694 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da446eb-6035-4b52-9d03-4825be85fc0b None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:06:57.384985 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da446eb-6035-4b52-9d03-4825be85fc0b None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:06:57.385265 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da446eb-6035-4b52-9d03-4825be85fc0b None admin] PATH_INFO: `/v3/domains` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:06:57.386027 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da446eb-6035-4b52-9d03-4825be85fc0b None admin] RBAC: Adding query filter params (name=Default) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:06:57.386337 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da446eb-6035-4b52-9d03-4825be85fc0b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:06:57.387715 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da446eb-6035-4b52-9d03-4825be85fc0b None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:06:57.399387 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 433/878] 10.222.0.136 () {56 vars in 1114 bytes} [Thu Jul 14 17:06:57 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:06:57.405488 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd32c054-a1e5-43c1-a3f7-380b91e9f73a None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:06:57.504640 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd32c054-a1e5-43c1-a3f7-380b91e9f73a None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:06:57.538992 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28b71be-9f10-457d-8be0-1608c525b8a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:06:57.539794 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28b71be-9f10-457d-8be0-1608c525b8a1 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:06:57.540082 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28b71be-9f10-457d-8be0-1608c525b8a1 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:06:57.540362 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28b71be-9f10-457d-8be0-1608c525b8a1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:06:57.548659 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28b71be-9f10-457d-8be0-1608c525b8a1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:06:57.551342 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28b71be-9f10-457d-8be0-1608c525b8a1 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:06:57.566609 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-b28b71be-9f10-457d-8be0-1608c525b8a1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 17:06:57.566609 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:06:57.566609 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:06:57.566609 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:06:57.566609 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:06:57.566609 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:06:57.566609 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:06:57.566609 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:06:57.566609 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:06:57.566609 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:06:57.566609 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:06:57.566609 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:06:57.566609 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 17:06:57.566609 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 17:06:57.566609 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 17:06:57.567677 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 17:06:57.567677 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:06:57.567677 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:06:57.567677 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:06:57.567677 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:06:57.567677 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:06:57.567677 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:06:57.567677 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:06:57.567677 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Jul 14 17:06:57.567677 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:06:57.567677 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:06:57.567677 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:06:57.567677 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:06:57.567677 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:06:57.567677 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:06:57.567677 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:06:57.567677 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:06:57.569214 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 17:06:57.569214 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 17:06:57.569214 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 17:06:57.569214 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 17:06:57.569214 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 17:06:57.569214 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 17:06:57.569214 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 17:06:57.569214 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Jul 14 17:06:57.569214 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 446/879] 10.222.0.136 () {56 vars in 1116 bytes} [Thu Jul 14 17:06:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:06:57.574463 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da446eb-6035-4b52-9d03-4825be85fc0b None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:06:57.674507 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da446eb-6035-4b52-9d03-4825be85fc0b None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:06:57.707656 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd63c67-5797-4a69-873c-5a3eedd49fed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:06:57.708312 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd63c67-5797-4a69-873c-5a3eedd49fed None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:06:57.708603 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd63c67-5797-4a69-873c-5a3eedd49fed None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:06:57.708889 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd63c67-5797-4a69-873c-5a3eedd49fed None admin] PATH_INFO: `/v3/projects` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:06:57.709707 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd63c67-5797-4a69-873c-5a3eedd49fed None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:06:57.710027 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd63c67-5797-4a69-873c-5a3eedd49fed None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:06:57.711463 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd63c67-5797-4a69-873c-5a3eedd49fed None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:06:57.724208 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 434/880] 10.222.0.136 () {56 vars in 1153 bytes} [Thu Jul 14 17:06:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:06:57.730582 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28b71be-9f10-457d-8be0-1608c525b8a1 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:06:57.754292 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:06:57.841801 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28b71be-9f10-457d-8be0-1608c525b8a1 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:06:57.876698 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b48e69c-5a36-45eb-821b-2d2a8a018503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:06:57.877349 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b48e69c-5a36-45eb-821b-2d2a8a018503 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:06:57.877677 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b48e69c-5a36-45eb-821b-2d2a8a018503 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:06:57.877963 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b48e69c-5a36-45eb-821b-2d2a8a018503 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:06:57.878789 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b48e69c-5a36-45eb-821b-2d2a8a018503 None admin] RBAC: Adding query filter params (role.id=284c6314b4d3492085e397a87b0e3b51, scope.project.id=d57eaa6dbca24cbb99dce1fe3437ecae, user.id=05cdf81bd7d14730962816677457e858) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:06:57.879106 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b48e69c-5a36-45eb-821b-2d2a8a018503 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:06:57.880529 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b48e69c-5a36-45eb-821b-2d2a8a018503 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:06:57.885949 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 447/881] 10.222.0.136 () {56 vars in 1379 bytes} [Thu Jul 14 17:06:57 2022] GET /identity/v3/role_assignments?user.id=05cdf81bd7d14730962816677457e858&scope.project.id=d57eaa6dbca24cbb99dce1fe3437ecae&role.id=284c6314b4d3492085e397a87b0e3b51 => generated 260 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:07:00.147939 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d15eea-1709-4b27-a545-ada375517187 None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:07:00.148477 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d15eea-1709-4b27-a545-ada375517187 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:07:00.148477 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d15eea-1709-4b27-a545-ada375517187 None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:07:00.149901 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 435/882] 10.222.0.136 () {54 vars in 931 bytes} [Thu Jul 14 17:07:00 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:07:00.155689 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5435b8-f13a-4caa-9a61-b6d4d4c7b07b None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:07:00.156311 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5435b8-f13a-4caa-9a61-b6d4d4c7b07b None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:07:00.156829 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5435b8-f13a-4caa-9a61-b6d4d4c7b07b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:07:00.173891 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-7e5435b8-f13a-4caa-9a61-b6d4d4c7b07b None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:07:00.175118 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-7e5435b8-f13a-4caa-9a61-b6d4d4c7b07b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:07:00.244348 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 448/883] 10.222.0.136 () {58 vars in 1028 bytes} [Thu Jul 14 17:07:00 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 17:07:00.269135 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d15eea-1709-4b27-a545-ada375517187 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:07:00.280056 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:07:00.369757 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d15eea-1709-4b27-a545-ada375517187 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:07:00.403425 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91cdfa0-5cd0-49b4-b5a8-049b632ae124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:07:00.404143 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91cdfa0-5cd0-49b4-b5a8-049b632ae124 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:07:00.404429 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91cdfa0-5cd0-49b4-b5a8-049b632ae124 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:07:00.404707 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91cdfa0-5cd0-49b4-b5a8-049b632ae124 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:07:00.414891 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91cdfa0-5cd0-49b4-b5a8-049b632ae124 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 17:07:00.422611 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-c91cdfa0-5cd0-49b4-b5a8-049b632ae124 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 17:07:00.422611 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:07:00.422611 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:07:00.422611 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:07:00.422611 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:07:00.422611 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:07:00.422611 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:07:00.422611 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:07:00.422611 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:07:00.422611 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:07:00.422611 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:07:00.422611 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:07:00.422611 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 17:07:00.422611 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 17:07:00.422611 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 17:07:00.422611 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 17:07:00.423702 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 17:07:00.423702 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 17:07:00.423702 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 17:07:00.423702 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 17:07:00.423702 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:07:00.423702 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:07:00.423702 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:07:00.423702 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:07:00.423702 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:07:00.423702 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:07:00.423702 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:07:00.423702 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Jul 14 17:07:00.423702 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:07:00.423702 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:07:00.423702 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:07:00.423702 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:07:00.424746 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:07:00.424746 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:07:00.424746 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:07:00.424746 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:07:00.424746 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 17:07:00.424746 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 17:07:00.424746 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 17:07:00.424746 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 17:07:00.424746 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 17:07:00.424746 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 17:07:00.424746 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 17:07:00.424746 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Jul 14 17:07:00.424746 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 436/884] 10.222.0.136 () {56 vars in 1101 bytes} [Thu Jul 14 17:07:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:07:00.430059 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5435b8-f13a-4caa-9a61-b6d4d4c7b07b None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:07:00.445450 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:07:00.531507 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5435b8-f13a-4caa-9a61-b6d4d4c7b07b None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:07:00.568400 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd3fc69-1f8d-4e1f-84d2-30b81b83763c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:07:00.569065 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd3fc69-1f8d-4e1f-84d2-30b81b83763c None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:07:00.569353 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd3fc69-1f8d-4e1f-84d2-30b81b83763c None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:07:00.569667 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd3fc69-1f8d-4e1f-84d2-30b81b83763c None admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:07:00.570419 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd3fc69-1f8d-4e1f-84d2-30b81b83763c None admin] RBAC: Adding query filter params (name=admin) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:07:00.570734 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd3fc69-1f8d-4e1f-84d2-30b81b83763c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:07:00.572092 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd3fc69-1f8d-4e1f-84d2-30b81b83763c None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:07:00.581287 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 449/885] 10.222.0.136 () {56 vars in 1104 bytes} [Thu Jul 14 17:07:00 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:07:00.587466 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91cdfa0-5cd0-49b4-b5a8-049b632ae124 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:07:00.652361 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:07:00.685637 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91cdfa0-5cd0-49b4-b5a8-049b632ae124 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:07:00.718470 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb6be4a-cc77-4e87-a248-77528b8f6805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:07:00.719243 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb6be4a-cc77-4e87-a248-77528b8f6805 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:07:00.719525 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb6be4a-cc77-4e87-a248-77528b8f6805 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:07:00.719799 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb6be4a-cc77-4e87-a248-77528b8f6805 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:07:00.730197 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb6be4a-cc77-4e87-a248-77528b8f6805 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:07:00.731626 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb6be4a-cc77-4e87-a248-77528b8f6805 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:07:00.748242 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-1eb6be4a-cc77-4e87-a248-77528b8f6805 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:07:00.748242 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:07:00.748242 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:07:00.748242 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:07:00.748242 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:07:00.748242 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:07:00.748242 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:07:00.748242 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:07:00.748242 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:07:00.748242 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:07:00.748242 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:07:00.748242 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:07:00.748242 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 17:07:00.748242 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 17:07:00.748242 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 17:07:00.749921 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 17:07:00.749921 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:07:00.749921 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:07:00.749921 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:07:00.749921 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:07:00.749921 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:07:00.749921 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:07:00.749921 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:07:00.749921 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Jul 14 17:07:00.749921 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:07:00.749921 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:07:00.749921 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:07:00.749921 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:07:00.749921 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:07:00.749921 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:07:00.749921 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:07:00.749921 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:07:00.751105 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 17:07:00.751105 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 17:07:00.751105 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:07:00.751105 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Jul 14 17:07:00.751105 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 437/886] 10.222.0.136 () {56 vars in 1113 bytes} [Thu Jul 14 17:07:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:07:00.755279 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd3fc69-1f8d-4e1f-84d2-30b81b83763c None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:07:00.851915 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:07:00.877008 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd3fc69-1f8d-4e1f-84d2-30b81b83763c None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:07:00.909984 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b754c7-5185-4e1b-99e4-888131bc7db1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:07:00.910639 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b754c7-5185-4e1b-99e4-888131bc7db1 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:07:00.910931 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b754c7-5185-4e1b-99e4-888131bc7db1 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:07:00.911216 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b754c7-5185-4e1b-99e4-888131bc7db1 None admin] PATH_INFO: `/v3/domains` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:07:00.911937 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b754c7-5185-4e1b-99e4-888131bc7db1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:07:00.912248 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b754c7-5185-4e1b-99e4-888131bc7db1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:07:00.913625 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b754c7-5185-4e1b-99e4-888131bc7db1 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:07:00.925937 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 450/887] 10.222.0.136 () {56 vars in 1114 bytes} [Thu Jul 14 17:07:00 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:07:00.931669 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb6be4a-cc77-4e87-a248-77528b8f6805 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:07:01.033535 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb6be4a-cc77-4e87-a248-77528b8f6805 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:07:01.053631 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:07:01.068476 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b87d13c-73c6-4fb0-8b05-007612195fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:07:01.069282 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b87d13c-73c6-4fb0-8b05-007612195fdf None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:07:01.069594 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b87d13c-73c6-4fb0-8b05-007612195fdf None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:07:01.069880 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b87d13c-73c6-4fb0-8b05-007612195fdf None admin] PATH_INFO: `/v3/users/placement` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:07:01.077373 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b87d13c-73c6-4fb0-8b05-007612195fdf None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:07:01.078847 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b87d13c-73c6-4fb0-8b05-007612195fdf None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:07:01.093435 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-9b87d13c-73c6-4fb0-8b05-007612195fdf None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 14 17:07:01.093435 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:07:01.093435 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:07:01.093435 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:07:01.093435 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:07:01.093435 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:07:01.093435 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:07:01.093435 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:07:01.093435 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:07:01.093435 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:07:01.093435 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:07:01.093435 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:07:01.093435 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 17:07:01.093435 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 17:07:01.093435 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 17:07:01.093435 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 17:07:01.094579 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:07:01.094579 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:07:01.094579 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 17:07:01.094579 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 17:07:01.094579 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 17:07:01.094579 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 17:07:01.094579 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:07:01.094579 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:07:01.094579 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:07:01.094579 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:07:01.094579 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:07:01.094579 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Jul 14 17:07:01.094579 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:07:01.094579 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:07:01.094579 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:07:01.094579 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:07:01.094579 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:07:01.094579 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:07:01.095742 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:07:01.095742 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:07:01.095742 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 17:07:01.095742 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 17:07:01.095742 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 17:07:01.095742 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 17:07:01.095742 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 17:07:01.095742 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 17:07:01.095742 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 14 17:07:01.095742 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Jul 14 17:07:01.095742 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 438/888] 10.222.0.136 () {56 vars in 1113 bytes} [Thu Jul 14 17:07:00 2022] GET /identity/v3/users/placement => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:07:01.100489 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b754c7-5185-4e1b-99e4-888131bc7db1 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:07:01.199157 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b754c7-5185-4e1b-99e4-888131bc7db1 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:07:01.234146 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97007ebc-f926-44ac-b505-7d447b19ab1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:07:01.234801 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97007ebc-f926-44ac-b505-7d447b19ab1c None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:07:01.235087 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97007ebc-f926-44ac-b505-7d447b19ab1c None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:07:01.235367 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97007ebc-f926-44ac-b505-7d447b19ab1c None admin] PATH_INFO: `/v3/users` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:07:01.236202 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97007ebc-f926-44ac-b505-7d447b19ab1c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:07:01.236512 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97007ebc-f926-44ac-b505-7d447b19ab1c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:07:01.237959 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97007ebc-f926-44ac-b505-7d447b19ab1c None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:07:01.240466 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:07:01.255973 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 451/889] 10.222.0.136 () {56 vars in 1148 bytes} [Thu Jul 14 17:07:01 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 380 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:07:01.261710 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b87d13c-73c6-4fb0-8b05-007612195fdf None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:07:01.362237 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b87d13c-73c6-4fb0-8b05-007612195fdf None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:07:01.394885 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43667ece-212d-41d8-a9ac-9122cad7fd6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:07:01.395667 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43667ece-212d-41d8-a9ac-9122cad7fd6d None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:07:01.395953 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43667ece-212d-41d8-a9ac-9122cad7fd6d None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:07:01.396232 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43667ece-212d-41d8-a9ac-9122cad7fd6d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:07:01.406686 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43667ece-212d-41d8-a9ac-9122cad7fd6d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:07:01.408121 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43667ece-212d-41d8-a9ac-9122cad7fd6d None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:07:01.425388 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-43667ece-212d-41d8-a9ac-9122cad7fd6d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:07:01.425388 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:07:01.425388 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:07:01.425388 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:07:01.425388 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:07:01.425388 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:07:01.425388 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:07:01.425388 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:07:01.425388 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:07:01.425388 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:07:01.425388 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:07:01.425388 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:07:01.425388 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 17:07:01.425388 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 17:07:01.425388 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 17:07:01.426503 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 17:07:01.426503 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:07:01.426503 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:07:01.426503 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:07:01.426503 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:07:01.426503 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:07:01.426503 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:07:01.426503 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:07:01.426503 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Jul 14 17:07:01.426503 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:07:01.426503 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:07:01.426503 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:07:01.426503 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:07:01.426503 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:07:01.426503 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:07:01.426503 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:07:01.426503 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:07:01.427636 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 17:07:01.427636 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 17:07:01.427636 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:07:01.427636 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Jul 14 17:07:01.427636 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 439/890] 10.222.0.136 () {56 vars in 1113 bytes} [Thu Jul 14 17:07:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:07:01.432438 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97007ebc-f926-44ac-b505-7d447b19ab1c None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:07:01.531696 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97007ebc-f926-44ac-b505-7d447b19ab1c None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:07:01.564656 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082e0ad8-28a2-4b9d-838e-2ed8133f3f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:07:01.565306 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082e0ad8-28a2-4b9d-838e-2ed8133f3f2b None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:07:01.565624 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082e0ad8-28a2-4b9d-838e-2ed8133f3f2b None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:07:01.565908 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082e0ad8-28a2-4b9d-838e-2ed8133f3f2b None admin] PATH_INFO: `/v3/domains` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:07:01.566626 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082e0ad8-28a2-4b9d-838e-2ed8133f3f2b None admin] RBAC: Adding query filter params (name=Default) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:07:01.566938 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082e0ad8-28a2-4b9d-838e-2ed8133f3f2b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:07:01.568372 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082e0ad8-28a2-4b9d-838e-2ed8133f3f2b None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:07:01.580586 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 452/891] 10.222.0.136 () {56 vars in 1114 bytes} [Thu Jul 14 17:07:01 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:07:01.586002 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43667ece-212d-41d8-a9ac-9122cad7fd6d None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:07:01.618350 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:07:01.687856 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43667ece-212d-41d8-a9ac-9122cad7fd6d None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:07:01.720619 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94573582-dbfd-418d-bb2d-1e1cf67edf9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:07:01.721408 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94573582-dbfd-418d-bb2d-1e1cf67edf9a None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:07:01.721730 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94573582-dbfd-418d-bb2d-1e1cf67edf9a None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:07:01.722016 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94573582-dbfd-418d-bb2d-1e1cf67edf9a None admin] PATH_INFO: `/v3/projects/service` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:07:01.728876 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94573582-dbfd-418d-bb2d-1e1cf67edf9a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:07:01.730354 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94573582-dbfd-418d-bb2d-1e1cf67edf9a None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:07:01.744944 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-94573582-dbfd-418d-bb2d-1e1cf67edf9a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 17:07:01.744944 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:07:01.744944 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:07:01.744944 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:07:01.744944 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:07:01.744944 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:07:01.744944 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:07:01.744944 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:07:01.744944 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:07:01.744944 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:07:01.744944 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:07:01.744944 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:07:01.744944 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 17:07:01.744944 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 17:07:01.744944 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 17:07:01.745964 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 17:07:01.745964 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:07:01.745964 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:07:01.745964 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:07:01.745964 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:07:01.745964 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:07:01.745964 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:07:01.745964 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:07:01.745964 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Jul 14 17:07:01.745964 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:07:01.745964 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:07:01.745964 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:07:01.745964 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:07:01.745964 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:07:01.745964 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:07:01.745964 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:07:01.745964 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:07:01.746877 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 17:07:01.746877 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 17:07:01.746877 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 17:07:01.746877 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 17:07:01.746877 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 17:07:01.746877 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 17:07:01.746877 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 17:07:01.746877 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Jul 14 17:07:01.746877 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 440/892] 10.222.0.136 () {56 vars in 1116 bytes} [Thu Jul 14 17:07:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:07:01.752478 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082e0ad8-28a2-4b9d-838e-2ed8133f3f2b None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:07:01.812278 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:07:01.864530 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082e0ad8-28a2-4b9d-838e-2ed8133f3f2b None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:07:01.897037 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c1512b-98ba-4e4b-ad85-44902fb3be63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:07:01.897657 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c1512b-98ba-4e4b-ad85-44902fb3be63 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:07:01.897943 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c1512b-98ba-4e4b-ad85-44902fb3be63 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:07:01.898219 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c1512b-98ba-4e4b-ad85-44902fb3be63 None admin] PATH_INFO: `/v3/projects` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:07:01.898996 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c1512b-98ba-4e4b-ad85-44902fb3be63 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:07:01.899303 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c1512b-98ba-4e4b-ad85-44902fb3be63 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:07:01.901192 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c1512b-98ba-4e4b-ad85-44902fb3be63 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:07:01.914184 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 453/893] 10.222.0.136 () {56 vars in 1153 bytes} [Thu Jul 14 17:07:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:07:01.920218 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94573582-dbfd-418d-bb2d-1e1cf67edf9a None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:07:02.009508 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:07:02.019164 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94573582-dbfd-418d-bb2d-1e1cf67edf9a None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:07:02.052303 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05de67b5-e1d2-4f4b-a992-ee51fcbcc79b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:07:02.053181 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05de67b5-e1d2-4f4b-a992-ee51fcbcc79b None admin] REQUEST_METHOD: `PUT` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:07:02.053460 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05de67b5-e1d2-4f4b-a992-ee51fcbcc79b None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:07:02.053762 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05de67b5-e1d2-4f4b-a992-ee51fcbcc79b None admin] PATH_INFO: `/v3/projects/d57eaa6dbca24cbb99dce1fe3437ecae/users/05cdf81bd7d14730962816677457e858/roles/284c6314b4d3492085e397a87b0e3b51` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:07:02.055680 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05de67b5-e1d2-4f4b-a992-ee51fcbcc79b None admin] RBAC: Authorizing `identity:create_grant(project_id=d57eaa6dbca24cbb99dce1fe3437ecae, user_id=05cdf81bd7d14730962816677457e858, role_id=284c6314b4d3492085e397a87b0e3b51)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:07:02.057127 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05de67b5-e1d2-4f4b-a992-ee51fcbcc79b None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:07:02.071076 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 441/894] 10.222.0.136 () {58 vars in 1444 bytes} [Thu Jul 14 17:07:01 2022] PUT /identity/v3/projects/d57eaa6dbca24cbb99dce1fe3437ecae/users/05cdf81bd7d14730962816677457e858/roles/284c6314b4d3492085e397a87b0e3b51 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:07:04.328370 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc122e9f-fd57-4502-a703-aa1356e6d2c7 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:07:04.328918 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc122e9f-fd57-4502-a703-aa1356e6d2c7 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:07:04.329012 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc122e9f-fd57-4502-a703-aa1356e6d2c7 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:07:04.330358 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 454/895] 10.222.0.136 () {54 vars in 931 bytes} [Thu Jul 14 17:07:04 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:07:04.335484 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36ccade-d6f3-4ca7-8c70-8d2c9d1496f6 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:07:04.335890 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36ccade-d6f3-4ca7-8c70-8d2c9d1496f6 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:07:04.336074 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36ccade-d6f3-4ca7-8c70-8d2c9d1496f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:07:04.352904 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-e36ccade-d6f3-4ca7-8c70-8d2c9d1496f6 None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:07:04.354108 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-e36ccade-d6f3-4ca7-8c70-8d2c9d1496f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:07:04.419529 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 442/896] 10.222.0.136 () {58 vars in 1028 bytes} [Thu Jul 14 17:07:04 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 17:07:04.445435 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc122e9f-fd57-4502-a703-aa1356e6d2c7 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:07:04.546809 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc122e9f-fd57-4502-a703-aa1356e6d2c7 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:07:04.560425 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:07:04.581554 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a76b34-7a5b-4333-9451-11feb12c6781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:07:04.582350 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a76b34-7a5b-4333-9451-11feb12c6781 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:07:04.582639 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a76b34-7a5b-4333-9451-11feb12c6781 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:07:04.582920 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a76b34-7a5b-4333-9451-11feb12c6781 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:07:04.593784 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a76b34-7a5b-4333-9451-11feb12c6781 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 17:07:04.601362 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-30a76b34-7a5b-4333-9451-11feb12c6781 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 17:07:04.601362 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:07:04.601362 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:07:04.601362 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:07:04.601362 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:07:04.601362 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:07:04.601362 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:07:04.601362 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:07:04.601362 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:07:04.601362 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:07:04.601362 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:07:04.601362 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:07:04.601362 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 17:07:04.601362 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 17:07:04.601362 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 17:07:04.601362 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 17:07:04.602728 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 17:07:04.602728 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 17:07:04.602728 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 17:07:04.602728 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 17:07:04.602728 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:07:04.602728 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:07:04.602728 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:07:04.602728 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:07:04.602728 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:07:04.602728 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:07:04.602728 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:07:04.602728 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Jul 14 17:07:04.602728 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:07:04.602728 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:07:04.602728 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:07:04.602728 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:07:04.603737 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:07:04.603737 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:07:04.603737 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:07:04.603737 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:07:04.603737 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 17:07:04.603737 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 17:07:04.603737 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 17:07:04.603737 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 17:07:04.603737 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 17:07:04.603737 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 17:07:04.603737 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 17:07:04.603737 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Jul 14 17:07:04.603737 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 455/897] 10.222.0.136 () {56 vars in 1101 bytes} [Thu Jul 14 17:07:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:07:04.608969 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36ccade-d6f3-4ca7-8c70-8d2c9d1496f6 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:07:04.689472 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:07:04.708251 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36ccade-d6f3-4ca7-8c70-8d2c9d1496f6 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:07:04.740813 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a60488-1471-4de7-94eb-fbc3a94905a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:07:04.741480 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a60488-1471-4de7-94eb-fbc3a94905a6 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:07:04.741796 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a60488-1471-4de7-94eb-fbc3a94905a6 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:07:04.742074 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a60488-1471-4de7-94eb-fbc3a94905a6 None admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:07:04.742815 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a60488-1471-4de7-94eb-fbc3a94905a6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:07:04.743121 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a60488-1471-4de7-94eb-fbc3a94905a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:07:04.744482 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a60488-1471-4de7-94eb-fbc3a94905a6 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:07:04.752856 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 443/898] 10.222.0.136 () {56 vars in 1104 bytes} [Thu Jul 14 17:07:04 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 17:07:04.758588 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a76b34-7a5b-4333-9451-11feb12c6781 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:07:04.876782 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a76b34-7a5b-4333-9451-11feb12c6781 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:07:04.912360 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d58bedb-f651-4523-91c0-3c701156930c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:07:04.913144 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d58bedb-f651-4523-91c0-3c701156930c None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:07:04.913435 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d58bedb-f651-4523-91c0-3c701156930c None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:07:04.913750 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d58bedb-f651-4523-91c0-3c701156930c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:07:04.925862 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d58bedb-f651-4523-91c0-3c701156930c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:07:04.927304 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d58bedb-f651-4523-91c0-3c701156930c None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:07:04.944871 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-3d58bedb-f651-4523-91c0-3c701156930c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:07:04.944871 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:07:04.944871 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:07:04.944871 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:07:04.944871 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:07:04.944871 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:07:04.944871 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:07:04.944871 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:07:04.944871 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:07:04.944871 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:07:04.944871 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:07:04.944871 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:07:04.944871 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 17:07:04.944871 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 17:07:04.944871 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 17:07:04.946017 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 17:07:04.946017 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:07:04.946017 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:07:04.946017 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:07:04.946017 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:07:04.946017 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:07:04.946017 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:07:04.946017 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:07:04.946017 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Jul 14 17:07:04.946017 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:07:04.946017 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:07:04.946017 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:07:04.946017 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:07:04.946017 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:07:04.946017 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:07:04.946017 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:07:04.946017 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:07:04.947300 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 17:07:04.947300 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 17:07:04.947300 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:07:04.947300 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Jul 14 17:07:04.947300 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 456/899] 10.222.0.136 () {56 vars in 1113 bytes} [Thu Jul 14 17:07:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:07:04.952659 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a60488-1471-4de7-94eb-fbc3a94905a6 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:07:05.057039 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a60488-1471-4de7-94eb-fbc3a94905a6 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:07:05.090448 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31656190-a926-4697-b15a-4f6ac05551d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:07:05.091105 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31656190-a926-4697-b15a-4f6ac05551d9 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:07:05.091391 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31656190-a926-4697-b15a-4f6ac05551d9 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:07:05.091670 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31656190-a926-4697-b15a-4f6ac05551d9 None admin] PATH_INFO: `/v3/domains` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:07:05.092924 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31656190-a926-4697-b15a-4f6ac05551d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:07:05.093307 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31656190-a926-4697-b15a-4f6ac05551d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:07:05.094662 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31656190-a926-4697-b15a-4f6ac05551d9 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:07:05.106272 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 444/900] 10.222.0.136 () {56 vars in 1114 bytes} [Thu Jul 14 17:07:04 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:07:05.112589 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d58bedb-f651-4523-91c0-3c701156930c None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:07:05.140571 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:07:05.214537 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d58bedb-f651-4523-91c0-3c701156930c None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:07:05.247841 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a7cca1-8c06-4bb6-b05f-dad1d6c6f901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:07:05.249258 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a7cca1-8c06-4bb6-b05f-dad1d6c6f901 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:07:05.249635 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a7cca1-8c06-4bb6-b05f-dad1d6c6f901 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:07:05.249847 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a7cca1-8c06-4bb6-b05f-dad1d6c6f901 None admin] PATH_INFO: `/v3/users/placement` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:07:05.257385 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a7cca1-8c06-4bb6-b05f-dad1d6c6f901 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:07:05.258849 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a7cca1-8c06-4bb6-b05f-dad1d6c6f901 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:07:05.273564 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-75a7cca1-8c06-4bb6-b05f-dad1d6c6f901 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 14 17:07:05.273564 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:07:05.273564 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:07:05.273564 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:07:05.273564 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:07:05.273564 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:07:05.273564 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:07:05.273564 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:07:05.273564 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:07:05.273564 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:07:05.273564 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:07:05.273564 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:07:05.273564 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 17:07:05.273564 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 17:07:05.273564 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 17:07:05.273564 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 17:07:05.274721 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:07:05.274721 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:07:05.274721 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 17:07:05.274721 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 17:07:05.274721 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 17:07:05.274721 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 17:07:05.274721 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:07:05.274721 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:07:05.274721 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:07:05.274721 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:07:05.274721 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:07:05.274721 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Jul 14 17:07:05.274721 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:07:05.274721 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:07:05.274721 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:07:05.274721 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:07:05.274721 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:07:05.274721 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:07:05.275687 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:07:05.275687 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:07:05.275687 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 17:07:05.275687 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 17:07:05.275687 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 17:07:05.275687 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 17:07:05.275687 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 17:07:05.275687 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 17:07:05.275687 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 14 17:07:05.275687 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Jul 14 17:07:05.275687 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 457/901] 10.222.0.136 () {56 vars in 1113 bytes} [Thu Jul 14 17:07:05 2022] GET /identity/v3/users/placement => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:07:05.281001 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31656190-a926-4697-b15a-4f6ac05551d9 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:07:05.284815 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:07:05.381077 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31656190-a926-4697-b15a-4f6ac05551d9 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:07:05.415341 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378b3192-6a14-48b6-86f2-5d542628c8fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:07:05.415946 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378b3192-6a14-48b6-86f2-5d542628c8fb None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:07:05.416232 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378b3192-6a14-48b6-86f2-5d542628c8fb None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:07:05.416513 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378b3192-6a14-48b6-86f2-5d542628c8fb None admin] PATH_INFO: `/v3/users` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:07:05.417341 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378b3192-6a14-48b6-86f2-5d542628c8fb None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:07:05.417695 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378b3192-6a14-48b6-86f2-5d542628c8fb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:07:05.419131 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378b3192-6a14-48b6-86f2-5d542628c8fb None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:07:05.436705 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 445/902] 10.222.0.136 () {56 vars in 1148 bytes} [Thu Jul 14 17:07:05 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 380 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:07:05.442577 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a7cca1-8c06-4bb6-b05f-dad1d6c6f901 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:07:05.531210 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:07:05.546297 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a7cca1-8c06-4bb6-b05f-dad1d6c6f901 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:07:05.579431 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936a3af8-0678-48b2-8ba3-facd2ce93c74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:07:05.580066 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936a3af8-0678-48b2-8ba3-facd2ce93c74 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:07:05.580358 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936a3af8-0678-48b2-8ba3-facd2ce93c74 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:07:05.580637 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936a3af8-0678-48b2-8ba3-facd2ce93c74 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:07:05.645732 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936a3af8-0678-48b2-8ba3-facd2ce93c74 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:07:05.647157 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936a3af8-0678-48b2-8ba3-facd2ce93c74 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:07:05.728284 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:07:05.744153 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 458/903] 10.222.0.136 () {58 vars in 1287 bytes} [Thu Jul 14 17:07:05 2022] GET /identity/v3/auth/tokens => generated 1863 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 17:07:05.749988 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378b3192-6a14-48b6-86f2-5d542628c8fb None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:07:05.813419 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:07:05.852000 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378b3192-6a14-48b6-86f2-5d542628c8fb None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:07:05.886117 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5ca52b-797b-4f19-badd-c6692f72dd44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:07:05.886912 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5ca52b-797b-4f19-badd-c6692f72dd44 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:07:05.887201 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5ca52b-797b-4f19-badd-c6692f72dd44 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:07:05.887480 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5ca52b-797b-4f19-badd-c6692f72dd44 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:07:05.898451 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5ca52b-797b-4f19-badd-c6692f72dd44 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:07:05.899894 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5ca52b-797b-4f19-badd-c6692f72dd44 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:07:05.918107 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-1b5ca52b-797b-4f19-badd-c6692f72dd44 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:07:05.918107 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:07:05.918107 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:07:05.918107 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:07:05.918107 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:07:05.918107 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:07:05.918107 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:07:05.918107 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:07:05.918107 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:07:05.918107 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:07:05.918107 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:07:05.918107 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:07:05.918107 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 17:07:05.918107 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 17:07:05.918107 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 17:07:05.919165 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 17:07:05.919165 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:07:05.919165 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:07:05.919165 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:07:05.919165 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:07:05.919165 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:07:05.919165 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:07:05.919165 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:07:05.919165 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Jul 14 17:07:05.919165 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:07:05.919165 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:07:05.919165 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:07:05.919165 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:07:05.919165 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:07:05.919165 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:07:05.919165 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:07:05.919165 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:07:05.920177 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 17:07:05.920177 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 17:07:05.920177 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:07:05.920177 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Jul 14 17:07:05.920177 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 446/904] 10.222.0.136 () {56 vars in 1113 bytes} [Thu Jul 14 17:07:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:07:05.925445 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936a3af8-0678-48b2-8ba3-facd2ce93c74 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:07:06.023520 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936a3af8-0678-48b2-8ba3-facd2ce93c74 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:07:06.058801 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfc88dd-ad3e-42b4-a7c4-39a553a15b9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:07:06.059463 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfc88dd-ad3e-42b4-a7c4-39a553a15b9c None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:07:06.059748 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfc88dd-ad3e-42b4-a7c4-39a553a15b9c None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:07:06.060028 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfc88dd-ad3e-42b4-a7c4-39a553a15b9c None admin] PATH_INFO: `/v3/domains` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:07:06.060746 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfc88dd-ad3e-42b4-a7c4-39a553a15b9c None admin] RBAC: Adding query filter params (name=Default) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:07:06.061059 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfc88dd-ad3e-42b4-a7c4-39a553a15b9c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:07:06.062537 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfc88dd-ad3e-42b4-a7c4-39a553a15b9c None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:07:06.073670 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 459/905] 10.222.0.136 () {56 vars in 1114 bytes} [Thu Jul 14 17:07:05 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:07:06.080293 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5ca52b-797b-4f19-badd-c6692f72dd44 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:07:06.188992 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5ca52b-797b-4f19-badd-c6692f72dd44 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:07:06.203643 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:07:06.223632 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8de2577-6ae0-4767-bf78-e2ea1293baae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:07:06.224428 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8de2577-6ae0-4767-bf78-e2ea1293baae None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:07:06.224712 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8de2577-6ae0-4767-bf78-e2ea1293baae None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:07:06.224988 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8de2577-6ae0-4767-bf78-e2ea1293baae None admin] PATH_INFO: `/v3/projects/service` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:07:06.231767 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8de2577-6ae0-4767-bf78-e2ea1293baae None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:07:06.233463 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8de2577-6ae0-4767-bf78-e2ea1293baae None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:07:06.246751 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-c8de2577-6ae0-4767-bf78-e2ea1293baae None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 17:07:06.246751 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:07:06.246751 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:07:06.246751 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:07:06.246751 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:07:06.246751 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:07:06.246751 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:07:06.246751 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:07:06.246751 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:07:06.246751 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:07:06.246751 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:07:06.246751 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:07:06.246751 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 17:07:06.246751 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 17:07:06.246751 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 17:07:06.247802 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 17:07:06.247802 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:07:06.247802 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:07:06.247802 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:07:06.247802 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:07:06.247802 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:07:06.247802 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:07:06.247802 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:07:06.247802 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Jul 14 17:07:06.247802 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:07:06.247802 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:07:06.247802 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:07:06.247802 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:07:06.247802 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:07:06.247802 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:07:06.247802 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:07:06.247802 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:07:06.249760 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 17:07:06.249760 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 17:07:06.249760 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 17:07:06.249760 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 17:07:06.249760 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 17:07:06.249760 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 17:07:06.249760 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 17:07:06.249760 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: ERROR keystone.server.flask.application Jul 14 17:07:06.249760 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 447/906] 10.222.0.136 () {56 vars in 1116 bytes} [Thu Jul 14 17:07:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:07:06.254293 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfc88dd-ad3e-42b4-a7c4-39a553a15b9c None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:07:06.301118 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:07:06.354709 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfc88dd-ad3e-42b4-a7c4-39a553a15b9c None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:07:06.387600 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43941e8f-7247-454a-b1dc-07cdfc9c838a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:07:06.388249 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43941e8f-7247-454a-b1dc-07cdfc9c838a None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:07:06.388534 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43941e8f-7247-454a-b1dc-07cdfc9c838a None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:07:06.388812 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43941e8f-7247-454a-b1dc-07cdfc9c838a None admin] PATH_INFO: `/v3/projects` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:07:06.389617 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43941e8f-7247-454a-b1dc-07cdfc9c838a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:07:06.389933 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43941e8f-7247-454a-b1dc-07cdfc9c838a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:07:06.391347 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43941e8f-7247-454a-b1dc-07cdfc9c838a None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:07:06.403033 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 460/907] 10.222.0.136 () {56 vars in 1153 bytes} [Thu Jul 14 17:07:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:07:06.410138 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8de2577-6ae0-4767-bf78-e2ea1293baae None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:07:06.511023 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8de2577-6ae0-4767-bf78-e2ea1293baae None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:07:06.544969 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed32257e-eaab-42a5-9993-9d44e1834778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:07:06.546161 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed32257e-eaab-42a5-9993-9d44e1834778 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:07:06.546454 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed32257e-eaab-42a5-9993-9d44e1834778 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:07:06.546736 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed32257e-eaab-42a5-9993-9d44e1834778 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:07:06.547560 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed32257e-eaab-42a5-9993-9d44e1834778 None admin] RBAC: Adding query filter params (role.id=284c6314b4d3492085e397a87b0e3b51, scope.project.id=d57eaa6dbca24cbb99dce1fe3437ecae, user.id=05cdf81bd7d14730962816677457e858) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:07:06.547884 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed32257e-eaab-42a5-9993-9d44e1834778 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:07:06.549314 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed32257e-eaab-42a5-9993-9d44e1834778 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:07:06.555101 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 448/908] 10.222.0.136 () {56 vars in 1379 bytes} [Thu Jul 14 17:07:06 2022] GET /identity/v3/role_assignments?user.id=05cdf81bd7d14730962816677457e858&scope.project.id=d57eaa6dbca24cbb99dce1fe3437ecae&role.id=284c6314b4d3492085e397a87b0e3b51 => generated 610 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:07:08.893258 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc79c209-05e4-4135-8538-5980fd8962b8 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:07:08.893823 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc79c209-05e4-4135-8538-5980fd8962b8 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:07:08.893823 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc79c209-05e4-4135-8538-5980fd8962b8 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:07:08.895187 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 461/909] 10.222.0.136 () {54 vars in 931 bytes} [Thu Jul 14 17:07:08 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:07:08.900511 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a345c5cf-da18-49c5-91c1-fe32e5ed1c96 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:07:08.900883 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a345c5cf-da18-49c5-91c1-fe32e5ed1c96 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:07:08.901089 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a345c5cf-da18-49c5-91c1-fe32e5ed1c96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:07:08.929254 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-a345c5cf-da18-49c5-91c1-fe32e5ed1c96 None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:07:08.930494 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-a345c5cf-da18-49c5-91c1-fe32e5ed1c96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:07:08.961147 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:07:09.001981 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 449/910] 10.222.0.136 () {58 vars in 1028 bytes} [Thu Jul 14 17:07:08 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 17:07:09.026627 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc79c209-05e4-4135-8538-5980fd8962b8 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:07:09.133096 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc79c209-05e4-4135-8538-5980fd8962b8 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:07:09.140528 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:07:09.167093 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91657a39-9012-40bd-b59b-34d2a72cee6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:07:09.167823 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91657a39-9012-40bd-b59b-34d2a72cee6f None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:07:09.168112 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91657a39-9012-40bd-b59b-34d2a72cee6f None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:07:09.168497 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91657a39-9012-40bd-b59b-34d2a72cee6f None admin] PATH_INFO: `/v3/services/placement` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:07:09.169070 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91657a39-9012-40bd-b59b-34d2a72cee6f None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:07:09.171099 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91657a39-9012-40bd-b59b-34d2a72cee6f None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:07:09.182757 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-91657a39-9012-40bd-b59b-34d2a72cee6f None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 14 17:07:09.182757 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:07:09.182757 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 17:07:09.182757 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 17:07:09.182757 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 17:07:09.182757 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 17:07:09.182757 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 17:07:09.182757 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 17:07:09.182757 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 14 17:07:09.182757 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Jul 14 17:07:09.182757 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 17:07:09.182757 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Jul 14 17:07:09.182757 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:07:09.182757 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:07:09.182757 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:07:09.182757 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:07:09.182757 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:07:09.183937 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:07:09.183937 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:07:09.183937 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:07:09.183937 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:07:09.183937 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:07:09.183937 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:07:09.183937 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 17:07:09.183937 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 17:07:09.183937 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 17:07:09.183937 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 17:07:09.183937 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:07:09.183937 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:07:09.183937 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:07:09.183937 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:07:09.183937 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:07:09.183937 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:07:09.185076 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:07:09.185076 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Jul 14 17:07:09.185076 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:07:09.185076 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:07:09.185076 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:07:09.185076 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:07:09.185076 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:07:09.185076 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:07:09.185076 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:07:09.185076 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:07:09.185076 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 17:07:09.185076 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 17:07:09.185076 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 14 17:07:09.185076 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Jul 14 17:07:09.185076 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 462/911] 10.222.0.136 () {56 vars in 1122 bytes} [Thu Jul 14 17:07:09 2022] GET /identity/v3/services/placement => generated 90 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:07:09.190039 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a345c5cf-da18-49c5-91c1-fe32e5ed1c96 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:07:09.286982 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a345c5cf-da18-49c5-91c1-fe32e5ed1c96 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:07:09.320489 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623e81af-7d10-41a9-a0b3-2c3e03c6d9ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:07:09.321151 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623e81af-7d10-41a9-a0b3-2c3e03c6d9ff None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:07:09.321439 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623e81af-7d10-41a9-a0b3-2c3e03c6d9ff None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:07:09.321746 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623e81af-7d10-41a9-a0b3-2c3e03c6d9ff None admin] PATH_INFO: `/v3/services` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:07:09.322445 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623e81af-7d10-41a9-a0b3-2c3e03c6d9ff None admin] RBAC: Adding query filter params (name=placement) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:07:09.322753 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623e81af-7d10-41a9-a0b3-2c3e03c6d9ff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:07:09.324121 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623e81af-7d10-41a9-a0b3-2c3e03c6d9ff None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:07:09.328950 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 450/912] 10.222.0.136 () {56 vars in 1121 bytes} [Thu Jul 14 17:07:09 2022] GET /identity/v3/services?name=placement => generated 127 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:07:09.334611 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91657a39-9012-40bd-b59b-34d2a72cee6f None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:07:09.435349 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91657a39-9012-40bd-b59b-34d2a72cee6f None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:07:09.468730 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e014fa-ea17-4322-a5b2-d1867c28beff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:07:09.469378 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e014fa-ea17-4322-a5b2-d1867c28beff None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:07:09.469697 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e014fa-ea17-4322-a5b2-d1867c28beff None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:07:09.469978 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e014fa-ea17-4322-a5b2-d1867c28beff None admin] PATH_INFO: `/v3/services` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:07:09.470688 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e014fa-ea17-4322-a5b2-d1867c28beff None admin] RBAC: Adding query filter params (type=placement) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:07:09.470996 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e014fa-ea17-4322-a5b2-d1867c28beff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:07:09.472348 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e014fa-ea17-4322-a5b2-d1867c28beff None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:07:09.476680 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 463/913] 10.222.0.136 () {56 vars in 1121 bytes} [Thu Jul 14 17:07:09 2022] GET /identity/v3/services?type=placement => generated 127 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:07:11.735686 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014817dc-df19-4643-99ae-7467ba60b9c8 None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:07:11.736225 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014817dc-df19-4643-99ae-7467ba60b9c8 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:07:11.736225 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014817dc-df19-4643-99ae-7467ba60b9c8 None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:07:11.737642 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 451/914] 10.222.0.136 () {54 vars in 931 bytes} [Thu Jul 14 17:07:11 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:07:11.742824 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd57171-1e12-421c-a6cc-e57cbba5415b None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:07:11.743232 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd57171-1e12-421c-a6cc-e57cbba5415b None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:07:11.743374 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd57171-1e12-421c-a6cc-e57cbba5415b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:07:11.760281 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-dfd57171-1e12-421c-a6cc-e57cbba5415b None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:07:11.761447 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-dfd57171-1e12-421c-a6cc-e57cbba5415b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:07:11.788507 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:07:11.843059 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 464/915] 10.222.0.136 () {58 vars in 1028 bytes} [Thu Jul 14 17:07:11 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 17:07:11.868234 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014817dc-df19-4643-99ae-7467ba60b9c8 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:07:11.899991 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:07:11.972511 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014817dc-df19-4643-99ae-7467ba60b9c8 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:07:12.005582 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572c6a40-2b74-4d70-b3e6-456943c6f518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:07:12.006177 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572c6a40-2b74-4d70-b3e6-456943c6f518 None admin] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:07:12.006465 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572c6a40-2b74-4d70-b3e6-456943c6f518 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:07:12.006745 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572c6a40-2b74-4d70-b3e6-456943c6f518 None admin] PATH_INFO: `/v3/services` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:07:12.007453 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572c6a40-2b74-4d70-b3e6-456943c6f518 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:07:12.008821 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572c6a40-2b74-4d70-b3e6-456943c6f518 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:07:12.022832 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 452/916] 10.222.0.136 () {60 vars in 1146 bytes} [Thu Jul 14 17:07:11 2022] POST /identity/v3/services => generated 247 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 17:07:14.279643 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed09102-ecce-4287-8b92-5a0e758da1ca None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:07:14.280199 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed09102-ecce-4287-8b92-5a0e758da1ca None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:07:14.280199 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed09102-ecce-4287-8b92-5a0e758da1ca None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:07:14.281568 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 465/917] 10.222.0.136 () {54 vars in 931 bytes} [Thu Jul 14 17:07:14 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:07:14.286925 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921136ae-535e-4a29-bc22-f7c3c5747c38 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:07:14.287318 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921136ae-535e-4a29-bc22-f7c3c5747c38 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:07:14.287499 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921136ae-535e-4a29-bc22-f7c3c5747c38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:07:14.304658 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-921136ae-535e-4a29-bc22-f7c3c5747c38 None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:07:14.305943 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-921136ae-535e-4a29-bc22-f7c3c5747c38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:07:14.377126 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 453/918] 10.222.0.136 () {58 vars in 1028 bytes} [Thu Jul 14 17:07:14 2022] POST /identity/v3/auth/tokens => generated 1966 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 17:07:14.400599 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed09102-ecce-4287-8b92-5a0e758da1ca None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:07:14.503062 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed09102-ecce-4287-8b92-5a0e758da1ca None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:07:14.535548 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c712af5-a55a-474c-9f4f-92fbbf40a1d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:07:14.536332 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c712af5-a55a-474c-9f4f-92fbbf40a1d9 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:07:14.536617 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c712af5-a55a-474c-9f4f-92fbbf40a1d9 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:07:14.536894 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c712af5-a55a-474c-9f4f-92fbbf40a1d9 None admin] PATH_INFO: `/v3/services/placement` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:07:14.537536 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c712af5-a55a-474c-9f4f-92fbbf40a1d9 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:07:14.538915 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c712af5-a55a-474c-9f4f-92fbbf40a1d9 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:07:14.551024 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-4c712af5-a55a-474c-9f4f-92fbbf40a1d9 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 14 17:07:14.551024 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:07:14.551024 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 17:07:14.551024 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 17:07:14.551024 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 17:07:14.551024 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 17:07:14.551024 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 17:07:14.551024 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 17:07:14.551024 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 14 17:07:14.551024 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Jul 14 17:07:14.551024 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 17:07:14.551024 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Jul 14 17:07:14.551024 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:07:14.551024 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:07:14.551024 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:07:14.551024 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:07:14.551024 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:07:14.552211 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:07:14.552211 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:07:14.552211 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:07:14.552211 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:07:14.552211 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:07:14.552211 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:07:14.552211 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 17:07:14.552211 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 17:07:14.552211 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 17:07:14.552211 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 17:07:14.552211 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:07:14.552211 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:07:14.552211 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:07:14.552211 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:07:14.552211 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:07:14.552211 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:07:14.553263 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:07:14.553263 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Jul 14 17:07:14.553263 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:07:14.553263 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:07:14.553263 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:07:14.553263 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:07:14.553263 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:07:14.553263 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:07:14.553263 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:07:14.553263 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:07:14.553263 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 17:07:14.553263 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 17:07:14.553263 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 14 17:07:14.553263 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Jul 14 17:07:14.553263 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 466/919] 10.222.0.136 () {56 vars in 1122 bytes} [Thu Jul 14 17:07:14 2022] GET /identity/v3/services/placement => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:07:14.558193 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921136ae-535e-4a29-bc22-f7c3c5747c38 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:07:14.581110 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:07:14.676670 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921136ae-535e-4a29-bc22-f7c3c5747c38 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:07:14.710030 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebd903c-ed66-4824-88a2-2ccd281363d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:07:14.710692 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebd903c-ed66-4824-88a2-2ccd281363d2 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:07:14.710978 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebd903c-ed66-4824-88a2-2ccd281363d2 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:07:14.711252 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebd903c-ed66-4824-88a2-2ccd281363d2 None admin] PATH_INFO: `/v3/services` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:07:14.711945 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebd903c-ed66-4824-88a2-2ccd281363d2 None admin] RBAC: Adding query filter params (name=placement) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:07:14.712250 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebd903c-ed66-4824-88a2-2ccd281363d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:07:14.713657 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebd903c-ed66-4824-88a2-2ccd281363d2 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:07:14.718581 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 454/920] 10.222.0.136 () {56 vars in 1121 bytes} [Thu Jul 14 17:07:14 2022] GET /identity/v3/services?name=placement => generated 360 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:07:14.724560 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c712af5-a55a-474c-9f4f-92fbbf40a1d9 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:07:14.756705 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:07:14.828745 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c712af5-a55a-474c-9f4f-92fbbf40a1d9 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:07:14.862286 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0cdb51-3783-4de4-a035-19f9f4898b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:07:14.862934 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0cdb51-3783-4de4-a035-19f9f4898b9a None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:07:14.863227 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0cdb51-3783-4de4-a035-19f9f4898b9a None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:07:14.863511 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0cdb51-3783-4de4-a035-19f9f4898b9a None admin] PATH_INFO: `/v3/endpoints` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:07:14.864296 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0cdb51-3783-4de4-a035-19f9f4898b9a None admin] RBAC: Adding query filter params (interface=public, service_id=270058fe14ff4fce89af806c901b8506, region_id=RegionOne) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:07:14.864616 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0cdb51-3783-4de4-a035-19f9f4898b9a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:07:14.866021 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0cdb51-3783-4de4-a035-19f9f4898b9a None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:07:14.871002 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 467/921] 10.222.0.136 () {56 vars in 1256 bytes} [Thu Jul 14 17:07:14 2022] GET /identity/v3/endpoints?service_id=270058fe14ff4fce89af806c901b8506&interface=public®ion_id=RegionOne => generated 195 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:07:14.877692 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebd903c-ed66-4824-88a2-2ccd281363d2 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:07:14.979546 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:07:14.999707 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebd903c-ed66-4824-88a2-2ccd281363d2 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:07:15.034583 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbd30da-44fa-4993-8fdb-453545b82428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:07:15.035250 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbd30da-44fa-4993-8fdb-453545b82428 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:07:15.035615 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbd30da-44fa-4993-8fdb-453545b82428 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:07:15.035940 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbd30da-44fa-4993-8fdb-453545b82428 None admin] PATH_INFO: `/v3/services` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:07:15.036765 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbd30da-44fa-4993-8fdb-453545b82428 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:07:15.038448 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbd30da-44fa-4993-8fdb-453545b82428 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:07:15.045522 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 455/922] 10.222.0.136 () {56 vars in 1092 bytes} [Thu Jul 14 17:07:14 2022] GET /identity/v3/services => generated 1971 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 17:07:17.298283 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01afb582-0aaf-4214-9bce-e526267959bc None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:07:17.298817 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01afb582-0aaf-4214-9bce-e526267959bc None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:07:17.298904 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01afb582-0aaf-4214-9bce-e526267959bc None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:07:17.300233 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 468/923] 10.222.0.136 () {54 vars in 931 bytes} [Thu Jul 14 17:07:17 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:07:17.305491 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b267551-4737-4049-ab50-20c1e0838105 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:07:17.305950 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b267551-4737-4049-ab50-20c1e0838105 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:07:17.306096 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b267551-4737-4049-ab50-20c1e0838105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:07:17.323470 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-5b267551-4737-4049-ab50-20c1e0838105 None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:07:17.324696 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-5b267551-4737-4049-ab50-20c1e0838105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:07:17.392229 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 456/924] 10.222.0.136 () {58 vars in 1028 bytes} [Thu Jul 14 17:07:17 2022] POST /identity/v3/auth/tokens => generated 1966 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 17:07:17.416613 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01afb582-0aaf-4214-9bce-e526267959bc None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:07:17.508397 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:07:17.518684 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01afb582-0aaf-4214-9bce-e526267959bc None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:07:17.552043 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2002086-66f9-47a6-a6f4-d4d53d905558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:07:17.552840 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2002086-66f9-47a6-a6f4-d4d53d905558 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:07:17.553130 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2002086-66f9-47a6-a6f4-d4d53d905558 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:07:17.553411 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2002086-66f9-47a6-a6f4-d4d53d905558 None admin] PATH_INFO: `/v3/services/placement` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:07:17.554093 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2002086-66f9-47a6-a6f4-d4d53d905558 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:07:17.555451 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2002086-66f9-47a6-a6f4-d4d53d905558 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:07:17.567736 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-d2002086-66f9-47a6-a6f4-d4d53d905558 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 14 17:07:17.567736 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:07:17.567736 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 17:07:17.567736 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 17:07:17.567736 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 17:07:17.567736 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 17:07:17.567736 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 17:07:17.567736 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 17:07:17.567736 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 14 17:07:17.567736 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Jul 14 17:07:17.567736 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 17:07:17.567736 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Jul 14 17:07:17.567736 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:07:17.567736 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:07:17.567736 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:07:17.567736 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:07:17.567736 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:07:17.568893 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:07:17.568893 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:07:17.568893 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:07:17.568893 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:07:17.568893 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:07:17.568893 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:07:17.568893 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 17:07:17.568893 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 17:07:17.568893 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 17:07:17.568893 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 17:07:17.568893 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:07:17.568893 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:07:17.568893 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:07:17.568893 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:07:17.568893 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:07:17.568893 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:07:17.570118 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:07:17.570118 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Jul 14 17:07:17.570118 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:07:17.570118 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:07:17.570118 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:07:17.570118 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:07:17.570118 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:07:17.570118 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:07:17.570118 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:07:17.570118 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:07:17.570118 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 17:07:17.570118 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 17:07:17.570118 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 14 17:07:17.570118 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: ERROR keystone.server.flask.application Jul 14 17:07:17.570118 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 469/925] 10.222.0.136 () {56 vars in 1122 bytes} [Thu Jul 14 17:07:17 2022] GET /identity/v3/services/placement => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:07:17.574993 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b267551-4737-4049-ab50-20c1e0838105 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:07:17.664514 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:07:17.687582 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b267551-4737-4049-ab50-20c1e0838105 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:07:17.720991 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89be2879-9207-46ac-87c5-ee02e0c7a4f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:07:17.721672 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89be2879-9207-46ac-87c5-ee02e0c7a4f9 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:07:17.721954 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89be2879-9207-46ac-87c5-ee02e0c7a4f9 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:07:17.722226 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89be2879-9207-46ac-87c5-ee02e0c7a4f9 None admin] PATH_INFO: `/v3/services` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:07:17.722919 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89be2879-9207-46ac-87c5-ee02e0c7a4f9 None admin] RBAC: Adding query filter params (name=placement) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:07:17.723221 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89be2879-9207-46ac-87c5-ee02e0c7a4f9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:07:17.724573 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89be2879-9207-46ac-87c5-ee02e0c7a4f9 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:07:17.729753 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 457/926] 10.222.0.136 () {56 vars in 1121 bytes} [Thu Jul 14 17:07:17 2022] GET /identity/v3/services?name=placement => generated 360 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:07:17.736020 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2002086-66f9-47a6-a6f4-d4d53d905558 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:07:17.835753 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2002086-66f9-47a6-a6f4-d4d53d905558 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:07:17.869660 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4a8760-1e8a-48c8-a580-1cbaf3bb60a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:07:17.870309 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4a8760-1e8a-48c8-a580-1cbaf3bb60a0 None admin] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:07:17.870599 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4a8760-1e8a-48c8-a580-1cbaf3bb60a0 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:07:17.870883 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4a8760-1e8a-48c8-a580-1cbaf3bb60a0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:07:17.871625 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4a8760-1e8a-48c8-a580-1cbaf3bb60a0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:07:17.873923 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4a8760-1e8a-48c8-a580-1cbaf3bb60a0 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:07:17.892316 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 470/927] 10.222.0.136 () {60 vars in 1149 bytes} [Thu Jul 14 17:07:17 2022] POST /identity/v3/endpoints => generated 333 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 17:07:27.726836 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=30 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:07:27.888613 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=93,keystone:INSERT=1 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:08:16.938794 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415d0fb5-3f3e-4e35-9507-9347989db4cc None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:08:16.939354 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415d0fb5-3f3e-4e35-9507-9347989db4cc None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:08:16.939354 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415d0fb5-3f3e-4e35-9507-9347989db4cc None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:08:16.940931 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 458/928] 10.222.0.136 () {54 vars in 931 bytes} [Thu Jul 14 17:08:16 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:08:16.945959 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a58c6e-fd63-47b2-a9a9-29006b288885 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:08:16.946447 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a58c6e-fd63-47b2-a9a9-29006b288885 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:08:16.946535 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a58c6e-fd63-47b2-a9a9-29006b288885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:08:16.970267 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-e4a58c6e-fd63-47b2-a9a9-29006b288885 None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:08:16.971613 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-e4a58c6e-fd63-47b2-a9a9-29006b288885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:08:17.107392 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 471/929] 10.222.0.136 () {58 vars in 1028 bytes} [Thu Jul 14 17:08:16 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:08:17.162861 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5035db9e-d489-4571-9932-ea046598652b None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:08:17.163158 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5035db9e-d489-4571-9932-ea046598652b None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:08:17.163443 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5035db9e-d489-4571-9932-ea046598652b None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:08:17.164974 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 459/930] 10.222.0.136 () {54 vars in 969 bytes} [Thu Jul 14 17:08:17 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:08:17.174052 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577031b1-bcde-4be2-a940-c06e7c2afe5d None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:08:17.174052 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577031b1-bcde-4be2-a940-c06e7c2afe5d None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:08:17.174052 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577031b1-bcde-4be2-a940-c06e7c2afe5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:08:17.257602 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-577031b1-bcde-4be2-a940-c06e7c2afe5d None None] MFA Rules not processed for user `a8c6871e11f047e284afdb16bcb1d3a4`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:08:17.258675 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-577031b1-bcde-4be2-a940-c06e7c2afe5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:08:17.347455 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 472/931] 10.222.0.136 () {58 vars in 1066 bytes} [Thu Jul 14 17:08:17 2022] POST /identity/v3/auth/tokens => generated 2679 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 17:08:17.357601 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5035db9e-d489-4571-9932-ea046598652b None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:08:17.368440 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5035db9e-d489-4571-9932-ea046598652b None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:08:17.372816 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adec6c3-50d1-4d28-9c91-d3f2475ecddf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8c6871e11f047e284afdb16bcb1d3a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd57eaa6dbca24cbb99dce1fe3437ecae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:08:17.373629 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adec6c3-50d1-4d28-9c91-d3f2475ecddf service neutron] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:08:17.374006 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adec6c3-50d1-4d28-9c91-d3f2475ecddf service neutron] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:08:17.374362 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adec6c3-50d1-4d28-9c91-d3f2475ecddf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:08:17.386881 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adec6c3-50d1-4d28-9c91-d3f2475ecddf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:08:17.388617 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adec6c3-50d1-4d28-9c91-d3f2475ecddf service neutron] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:08:17.399797 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 460/932] 10.222.0.136 () {60 vars in 1370 bytes} [Thu Jul 14 17:08:17 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 17:08:20.045213 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7a1225-610f-441f-817d-146a11a594a6 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:08:20.045810 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7a1225-610f-441f-817d-146a11a594a6 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:08:20.045810 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7a1225-610f-441f-817d-146a11a594a6 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:08:20.047185 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 473/933] 10.222.0.136 () {54 vars in 931 bytes} [Thu Jul 14 17:08:20 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:08:20.052379 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd930a6b-88fa-4c71-ba4e-299e7bb2f045 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:08:20.052809 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd930a6b-88fa-4c71-ba4e-299e7bb2f045 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:08:20.053070 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd930a6b-88fa-4c71-ba4e-299e7bb2f045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:08:20.071999 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-cd930a6b-88fa-4c71-ba4e-299e7bb2f045 None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:08:20.073196 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-cd930a6b-88fa-4c71-ba4e-299e7bb2f045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:08:20.085950 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 461/934] 10.222.0.136 () {58 vars in 1028 bytes} [Thu Jul 14 17:08:20 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:08:20.132533 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7a1225-610f-441f-817d-146a11a594a6 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:08:20.148427 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7a1225-610f-441f-817d-146a11a594a6 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:08:20.152924 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab355743-715b-4d48-94ed-8038335fa4cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8c6871e11f047e284afdb16bcb1d3a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd57eaa6dbca24cbb99dce1fe3437ecae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:08:20.153627 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab355743-715b-4d48-94ed-8038335fa4cf service neutron] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:08:20.153920 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab355743-715b-4d48-94ed-8038335fa4cf service neutron] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:08:20.154200 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab355743-715b-4d48-94ed-8038335fa4cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:08:20.166837 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab355743-715b-4d48-94ed-8038335fa4cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:08:20.166837 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab355743-715b-4d48-94ed-8038335fa4cf service neutron] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:08:20.177674 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 474/935] 10.222.0.136 () {60 vars in 1370 bytes} [Thu Jul 14 17:08:20 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:08:22.811565 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5023314-f728-406c-b7dd-b0f67ef36388 None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:08:22.812190 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5023314-f728-406c-b7dd-b0f67ef36388 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:08:22.812552 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5023314-f728-406c-b7dd-b0f67ef36388 None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:08:22.815243 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 462/936] 10.222.0.136 () {54 vars in 931 bytes} [Thu Jul 14 17:08:22 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:08:22.825178 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d567e19-0e3d-4be8-a95f-bd0541fa876b None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:08:22.825178 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d567e19-0e3d-4be8-a95f-bd0541fa876b None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:08:22.825178 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d567e19-0e3d-4be8-a95f-bd0541fa876b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:08:22.862867 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-1d567e19-0e3d-4be8-a95f-bd0541fa876b None None] MFA Rules not processed for user `4a702add54724509bfb0e585a8aa4add`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:08:22.864054 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-1d567e19-0e3d-4be8-a95f-bd0541fa876b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:08:22.905873 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:08:22.936915 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 475/937] 10.222.0.136 () {58 vars in 1028 bytes} [Thu Jul 14 17:08:22 2022] POST /identity/v3/auth/tokens => generated 2801 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:08:22.977774 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5023314-f728-406c-b7dd-b0f67ef36388 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:08:22.990047 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5023314-f728-406c-b7dd-b0f67ef36388 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:08:22.993589 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dca343-e9d0-41c1-8655-47d1a50681d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8c6871e11f047e284afdb16bcb1d3a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd57eaa6dbca24cbb99dce1fe3437ecae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:08:22.994340 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dca343-e9d0-41c1-8655-47d1a50681d6 service neutron] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:08:22.994964 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dca343-e9d0-41c1-8655-47d1a50681d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:08:22.995176 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dca343-e9d0-41c1-8655-47d1a50681d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:08:23.006410 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dca343-e9d0-41c1-8655-47d1a50681d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:08:23.007935 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dca343-e9d0-41c1-8655-47d1a50681d6 service neutron] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:08:23.019207 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 463/938] 10.222.0.136 () {60 vars in 1370 bytes} [Thu Jul 14 17:08:22 2022] GET /identity/v3/auth/tokens => generated 2801 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:08:26.003867 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206b700c-b4e8-44ea-a970-d927ca3740b4 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:08:26.004402 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206b700c-b4e8-44ea-a970-d927ca3740b4 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:08:26.004402 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206b700c-b4e8-44ea-a970-d927ca3740b4 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:08:26.005820 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 476/939] 10.222.0.136 () {54 vars in 931 bytes} [Thu Jul 14 17:08:26 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:08:26.011523 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be71d476-16e3-49c2-a457-d87de5c1b312 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:08:26.012382 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be71d476-16e3-49c2-a457-d87de5c1b312 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:08:26.012382 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be71d476-16e3-49c2-a457-d87de5c1b312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:08:26.030096 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-be71d476-16e3-49c2-a457-d87de5c1b312 None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:08:26.031251 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-be71d476-16e3-49c2-a457-d87de5c1b312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:08:26.096087 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 464/940] 10.222.0.136 () {58 vars in 1028 bytes} [Thu Jul 14 17:08:26 2022] POST /identity/v3/auth/tokens => generated 2796 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:08:26.137488 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206b700c-b4e8-44ea-a970-d927ca3740b4 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:08:26.147868 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206b700c-b4e8-44ea-a970-d927ca3740b4 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:08:26.151243 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa53237-ea1b-4e2b-84d4-6db430fa8405 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8c6871e11f047e284afdb16bcb1d3a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd57eaa6dbca24cbb99dce1fe3437ecae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:08:26.152034 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa53237-ea1b-4e2b-84d4-6db430fa8405 service neutron] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:08:26.152248 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa53237-ea1b-4e2b-84d4-6db430fa8405 service neutron] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:08:26.152524 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa53237-ea1b-4e2b-84d4-6db430fa8405 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:08:26.161193 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa53237-ea1b-4e2b-84d4-6db430fa8405 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:08:26.162643 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa53237-ea1b-4e2b-84d4-6db430fa8405 service neutron] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:08:26.172412 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 477/941] 10.222.0.136 () {60 vars in 1370 bytes} [Thu Jul 14 17:08:26 2022] GET /identity/v3/auth/tokens => generated 2796 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 17:08:29.109684 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abbc2a7-d545-4ea4-a56a-c4581b80810f None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:08:29.110186 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abbc2a7-d545-4ea4-a56a-c4581b80810f None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:08:29.110186 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abbc2a7-d545-4ea4-a56a-c4581b80810f None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:08:29.111721 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 465/942] 10.222.0.136 () {54 vars in 931 bytes} [Thu Jul 14 17:08:29 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:08:29.116751 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd49b9e7-eb2f-4ed9-9d7c-85725f264e1b None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:08:29.117160 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd49b9e7-eb2f-4ed9-9d7c-85725f264e1b None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:08:29.117322 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd49b9e7-eb2f-4ed9-9d7c-85725f264e1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:08:29.136107 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-bd49b9e7-eb2f-4ed9-9d7c-85725f264e1b None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:08:29.137311 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-bd49b9e7-eb2f-4ed9-9d7c-85725f264e1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:08:29.145120 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 478/943] 10.222.0.136 () {58 vars in 1028 bytes} [Thu Jul 14 17:08:29 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:08:29.184889 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abbc2a7-d545-4ea4-a56a-c4581b80810f None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:08:29.195811 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abbc2a7-d545-4ea4-a56a-c4581b80810f None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:08:29.203485 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf67bb43-d83b-4b83-9edb-bd3f394583db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8c6871e11f047e284afdb16bcb1d3a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd57eaa6dbca24cbb99dce1fe3437ecae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:08:29.204143 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf67bb43-d83b-4b83-9edb-bd3f394583db service neutron] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:08:29.204434 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf67bb43-d83b-4b83-9edb-bd3f394583db service neutron] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:08:29.204716 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf67bb43-d83b-4b83-9edb-bd3f394583db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:08:29.216833 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf67bb43-d83b-4b83-9edb-bd3f394583db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:08:29.218414 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf67bb43-d83b-4b83-9edb-bd3f394583db service neutron] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:08:29.233292 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 466/944] 10.222.0.136 () {60 vars in 1370 bytes} [Thu Jul 14 17:08:29 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:08:31.554205 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c3123c-a93f-425f-a6d6-b414273310a8 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:08:31.554716 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c3123c-a93f-425f-a6d6-b414273310a8 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:08:31.554716 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c3123c-a93f-425f-a6d6-b414273310a8 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:08:31.556431 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 479/945] 10.222.0.136 () {54 vars in 931 bytes} [Thu Jul 14 17:08:31 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:08:31.561570 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9437999e-4a63-4293-b105-3740854a45f2 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:08:31.561996 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9437999e-4a63-4293-b105-3740854a45f2 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:08:31.562151 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9437999e-4a63-4293-b105-3740854a45f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:08:31.580231 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-9437999e-4a63-4293-b105-3740854a45f2 None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:08:31.581425 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-9437999e-4a63-4293-b105-3740854a45f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:08:31.590055 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 467/946] 10.222.0.136 () {58 vars in 1028 bytes} [Thu Jul 14 17:08:31 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:08:31.628280 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c3123c-a93f-425f-a6d6-b414273310a8 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:08:31.639264 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c3123c-a93f-425f-a6d6-b414273310a8 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:08:31.642624 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12416fe6-a382-4d00-97d0-5186c59bc6ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8c6871e11f047e284afdb16bcb1d3a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd57eaa6dbca24cbb99dce1fe3437ecae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:08:31.643251 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12416fe6-a382-4d00-97d0-5186c59bc6ed service neutron] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:08:31.643531 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12416fe6-a382-4d00-97d0-5186c59bc6ed service neutron] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:08:31.643804 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12416fe6-a382-4d00-97d0-5186c59bc6ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:08:31.653173 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12416fe6-a382-4d00-97d0-5186c59bc6ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:08:31.654615 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12416fe6-a382-4d00-97d0-5186c59bc6ed service neutron] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:08:31.663857 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 480/947] 10.222.0.136 () {60 vars in 1370 bytes} [Thu Jul 14 17:08:31 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:08:34.032354 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e742e9-016b-4aa8-94d3-639ee47dd565 None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:08:34.032940 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e742e9-016b-4aa8-94d3-639ee47dd565 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:08:34.032940 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e742e9-016b-4aa8-94d3-639ee47dd565 None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:08:34.034310 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 468/948] 10.222.0.136 () {54 vars in 931 bytes} [Thu Jul 14 17:08:34 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:08:34.039408 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb42620-f1c0-4dd3-8866-d4ecccc7bbf3 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:08:34.039823 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb42620-f1c0-4dd3-8866-d4ecccc7bbf3 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:08:34.040099 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb42620-f1c0-4dd3-8866-d4ecccc7bbf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:08:34.058341 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-9eb42620-f1c0-4dd3-8866-d4ecccc7bbf3 None None] MFA Rules not processed for user `4a702add54724509bfb0e585a8aa4add`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:08:34.059517 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-9eb42620-f1c0-4dd3-8866-d4ecccc7bbf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:08:34.067340 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 481/949] 10.222.0.136 () {58 vars in 1028 bytes} [Thu Jul 14 17:08:34 2022] POST /identity/v3/auth/tokens => generated 2801 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 17:08:34.119494 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1cd4ae-93a3-4ce3-a9dd-afcd8bd8d90d None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:08:34.120359 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1cd4ae-93a3-4ce3-a9dd-afcd8bd8d90d None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:08:34.120677 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1cd4ae-93a3-4ce3-a9dd-afcd8bd8d90d None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:08:34.122185 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 469/950] 10.222.0.136 () {54 vars in 969 bytes} [Thu Jul 14 17:08:34 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:08:34.128333 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82f1ddd-ebc6-4e9c-823b-95c660cc790e None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:08:34.128620 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82f1ddd-ebc6-4e9c-823b-95c660cc790e None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:08:34.128900 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82f1ddd-ebc6-4e9c-823b-95c660cc790e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:08:34.147112 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-b82f1ddd-ebc6-4e9c-823b-95c660cc790e None None] MFA Rules not processed for user `a8c6871e11f047e284afdb16bcb1d3a4`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:08:34.148295 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-b82f1ddd-ebc6-4e9c-823b-95c660cc790e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:08:34.155890 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 482/951] 10.222.0.136 () {58 vars in 1066 bytes} [Thu Jul 14 17:08:34 2022] POST /identity/v3/auth/tokens => generated 2679 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 17:08:34.164665 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1cd4ae-93a3-4ce3-a9dd-afcd8bd8d90d None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:08:34.176117 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1cd4ae-93a3-4ce3-a9dd-afcd8bd8d90d None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:08:34.179523 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570024b2-814b-46f6-bc71-a87f52ae3680 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8c6871e11f047e284afdb16bcb1d3a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd57eaa6dbca24cbb99dce1fe3437ecae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:08:34.180158 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570024b2-814b-46f6-bc71-a87f52ae3680 service neutron] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:08:34.180438 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570024b2-814b-46f6-bc71-a87f52ae3680 service neutron] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:08:34.180713 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570024b2-814b-46f6-bc71-a87f52ae3680 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:08:34.190955 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570024b2-814b-46f6-bc71-a87f52ae3680 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:08:34.192382 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570024b2-814b-46f6-bc71-a87f52ae3680 service neutron] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:08:34.202714 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 470/952] 10.222.0.136 () {60 vars in 1370 bytes} [Thu Jul 14 17:08:34 2022] GET /identity/v3/auth/tokens => generated 2801 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:08:37.196374 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc38509c-58ff-4faf-995f-8352765ee8e1 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:08:37.196872 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc38509c-58ff-4faf-995f-8352765ee8e1 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:08:37.196872 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc38509c-58ff-4faf-995f-8352765ee8e1 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:08:37.199142 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 483/953] 10.222.0.136 () {54 vars in 931 bytes} [Thu Jul 14 17:08:37 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:08:37.204581 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9f6b26-4616-4dc5-a373-5e97593dd636 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:08:37.205079 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9f6b26-4616-4dc5-a373-5e97593dd636 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:08:37.205176 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9f6b26-4616-4dc5-a373-5e97593dd636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:08:37.224335 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-7d9f6b26-4616-4dc5-a373-5e97593dd636 None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:08:37.225860 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-7d9f6b26-4616-4dc5-a373-5e97593dd636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:08:37.234803 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 471/954] 10.222.0.136 () {58 vars in 1028 bytes} [Thu Jul 14 17:08:37 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:08:37.273259 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc38509c-58ff-4faf-995f-8352765ee8e1 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:08:37.284910 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc38509c-58ff-4faf-995f-8352765ee8e1 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:08:37.288386 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e30a4a-650e-42f1-9eb0-bb6c0ffc3f58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8c6871e11f047e284afdb16bcb1d3a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd57eaa6dbca24cbb99dce1fe3437ecae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:08:37.289076 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e30a4a-650e-42f1-9eb0-bb6c0ffc3f58 service neutron] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:08:37.289362 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e30a4a-650e-42f1-9eb0-bb6c0ffc3f58 service neutron] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:08:37.289684 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e30a4a-650e-42f1-9eb0-bb6c0ffc3f58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:08:37.300069 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e30a4a-650e-42f1-9eb0-bb6c0ffc3f58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:08:37.301508 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e30a4a-650e-42f1-9eb0-bb6c0ffc3f58 service neutron] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:08:37.312754 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 484/955] 10.222.0.136 () {60 vars in 1370 bytes} [Thu Jul 14 17:08:37 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:08:39.645980 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e43b603-a7c5-4bf6-90f5-6c2fe385c86d None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:08:39.646541 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e43b603-a7c5-4bf6-90f5-6c2fe385c86d None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:08:39.646541 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e43b603-a7c5-4bf6-90f5-6c2fe385c86d None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:08:39.647898 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 472/956] 10.222.0.136 () {54 vars in 931 bytes} [Thu Jul 14 17:08:39 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:08:39.653153 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e195a1-f102-4114-bf1e-d90dcca15020 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:08:39.653600 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e195a1-f102-4114-bf1e-d90dcca15020 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:08:39.653806 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e195a1-f102-4114-bf1e-d90dcca15020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:08:39.672070 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-58e195a1-f102-4114-bf1e-d90dcca15020 None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:08:39.673247 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-58e195a1-f102-4114-bf1e-d90dcca15020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:08:39.680866 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 485/957] 10.222.0.136 () {58 vars in 1028 bytes} [Thu Jul 14 17:08:39 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:08:39.723705 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e43b603-a7c5-4bf6-90f5-6c2fe385c86d None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:08:39.729522 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=65 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:08:39.735766 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e43b603-a7c5-4bf6-90f5-6c2fe385c86d None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:08:39.739290 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9f87ce-cc8f-449c-bd37-3f93af39f831 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8c6871e11f047e284afdb16bcb1d3a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd57eaa6dbca24cbb99dce1fe3437ecae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:08:39.740000 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9f87ce-cc8f-449c-bd37-3f93af39f831 service neutron] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:08:39.740352 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9f87ce-cc8f-449c-bd37-3f93af39f831 service neutron] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:08:39.740694 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9f87ce-cc8f-449c-bd37-3f93af39f831 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:08:39.750096 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9f87ce-cc8f-449c-bd37-3f93af39f831 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:08:39.751525 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9f87ce-cc8f-449c-bd37-3f93af39f831 service neutron] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:08:39.761788 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 473/958] 10.222.0.136 () {60 vars in 1370 bytes} [Thu Jul 14 17:08:39 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:08:42.520001 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b054bc98-539f-4468-b803-8bfc4f5187c1 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:08:42.520525 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b054bc98-539f-4468-b803-8bfc4f5187c1 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:08:42.520525 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b054bc98-539f-4468-b803-8bfc4f5187c1 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:08:42.521917 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 486/959] 10.222.0.136 () {54 vars in 931 bytes} [Thu Jul 14 17:08:42 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:08:42.527142 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c356b2-afde-4362-a750-788dcc5bdf39 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:08:42.527556 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c356b2-afde-4362-a750-788dcc5bdf39 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:08:42.527695 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c356b2-afde-4362-a750-788dcc5bdf39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:08:42.546839 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-86c356b2-afde-4362-a750-788dcc5bdf39 None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:08:42.548051 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-86c356b2-afde-4362-a750-788dcc5bdf39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:08:42.555861 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 474/960] 10.222.0.136 () {58 vars in 1028 bytes} [Thu Jul 14 17:08:42 2022] POST /identity/v3/auth/tokens => generated 2796 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:08:42.593679 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b054bc98-539f-4468-b803-8bfc4f5187c1 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:08:42.605061 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b054bc98-539f-4468-b803-8bfc4f5187c1 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:08:42.608500 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bee1fcb-23a4-445d-b670-1152379f4fc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8c6871e11f047e284afdb16bcb1d3a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd57eaa6dbca24cbb99dce1fe3437ecae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:08:42.609124 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bee1fcb-23a4-445d-b670-1152379f4fc5 service neutron] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:08:42.609403 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bee1fcb-23a4-445d-b670-1152379f4fc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:08:42.609714 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bee1fcb-23a4-445d-b670-1152379f4fc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:08:42.618413 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bee1fcb-23a4-445d-b670-1152379f4fc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:08:42.620476 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bee1fcb-23a4-445d-b670-1152379f4fc5 service neutron] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:08:42.629716 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 487/961] 10.222.0.136 () {60 vars in 1370 bytes} [Thu Jul 14 17:08:42 2022] GET /identity/v3/auth/tokens => generated 2796 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:08:46.914046 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3695b5ee-9c9b-46e6-bcf7-3ce396a88f42 None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:08:46.914566 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3695b5ee-9c9b-46e6-bcf7-3ce396a88f42 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:08:46.914779 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3695b5ee-9c9b-46e6-bcf7-3ce396a88f42 None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:08:46.916764 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 475/962] 10.222.0.136 () {54 vars in 931 bytes} [Thu Jul 14 17:08:46 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 14 17:08:46.922066 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f89ebb-2a1b-47f2-8410-444a3310aac3 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:08:46.922488 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f89ebb-2a1b-47f2-8410-444a3310aac3 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:08:46.922638 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f89ebb-2a1b-47f2-8410-444a3310aac3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:08:46.940595 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-27f89ebb-2a1b-47f2-8410-444a3310aac3 None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:08:46.941819 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-27f89ebb-2a1b-47f2-8410-444a3310aac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:08:46.950086 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 488/963] 10.222.0.136 () {58 vars in 1028 bytes} [Thu Jul 14 17:08:46 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:08:46.991616 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3695b5ee-9c9b-46e6-bcf7-3ce396a88f42 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:08:47.002350 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3695b5ee-9c9b-46e6-bcf7-3ce396a88f42 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:08:47.005823 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c9c7ab-6c24-4cee-84fa-b502b5f9a092 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8c6871e11f047e284afdb16bcb1d3a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd57eaa6dbca24cbb99dce1fe3437ecae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:08:47.006461 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c9c7ab-6c24-4cee-84fa-b502b5f9a092 service neutron] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:08:47.006748 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c9c7ab-6c24-4cee-84fa-b502b5f9a092 service neutron] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:08:47.007029 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c9c7ab-6c24-4cee-84fa-b502b5f9a092 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:08:47.016437 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c9c7ab-6c24-4cee-84fa-b502b5f9a092 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:08:47.017898 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c9c7ab-6c24-4cee-84fa-b502b5f9a092 service neutron] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:08:47.027736 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 476/964] 10.222.0.136 () {60 vars in 1370 bytes} [Thu Jul 14 17:08:46 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:08:49.969816 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb024dae-07a9-4f22-bf05-c34d333642cc None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:08:49.970372 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb024dae-07a9-4f22-bf05-c34d333642cc None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:08:49.970372 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb024dae-07a9-4f22-bf05-c34d333642cc None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:08:49.971873 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 489/965] 10.222.0.136 () {54 vars in 931 bytes} [Thu Jul 14 17:08:49 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:08:49.977252 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790ad6a2-32ae-4ba8-a26c-a0c3cbf4139f None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:08:49.977668 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790ad6a2-32ae-4ba8-a26c-a0c3cbf4139f None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:08:49.977842 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790ad6a2-32ae-4ba8-a26c-a0c3cbf4139f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:08:49.996524 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-790ad6a2-32ae-4ba8-a26c-a0c3cbf4139f None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:08:49.997739 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-790ad6a2-32ae-4ba8-a26c-a0c3cbf4139f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:08:50.005368 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 477/966] 10.222.0.136 () {58 vars in 1028 bytes} [Thu Jul 14 17:08:49 2022] POST /identity/v3/auth/tokens => generated 2796 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:08:50.044337 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb024dae-07a9-4f22-bf05-c34d333642cc None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:08:50.055087 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb024dae-07a9-4f22-bf05-c34d333642cc None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:08:50.059238 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef8f787-5733-4bc9-931b-584aa290c0b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8c6871e11f047e284afdb16bcb1d3a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd57eaa6dbca24cbb99dce1fe3437ecae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:08:50.059871 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef8f787-5733-4bc9-931b-584aa290c0b9 service neutron] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:08:50.060152 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef8f787-5733-4bc9-931b-584aa290c0b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:08:50.060456 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef8f787-5733-4bc9-931b-584aa290c0b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:08:50.069428 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef8f787-5733-4bc9-931b-584aa290c0b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:08:50.070903 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef8f787-5733-4bc9-931b-584aa290c0b9 service neutron] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:08:50.081827 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 490/967] 10.222.0.136 () {60 vars in 1370 bytes} [Thu Jul 14 17:08:50 2022] GET /identity/v3/auth/tokens => generated 2796 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:08:54.451339 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f708b08-f815-4719-8005-0236f7ea6a03 None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:08:54.451844 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f708b08-f815-4719-8005-0236f7ea6a03 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:08:54.451943 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f708b08-f815-4719-8005-0236f7ea6a03 None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:08:54.453429 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 478/968] 10.222.0.136 () {54 vars in 931 bytes} [Thu Jul 14 17:08:54 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:08:54.458856 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afcdec4-1356-4123-8811-028722b18dcf None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:08:54.459350 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afcdec4-1356-4123-8811-028722b18dcf None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:08:54.459446 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afcdec4-1356-4123-8811-028722b18dcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:08:54.465574 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=57 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:08:54.479761 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-0afcdec4-1356-4123-8811-028722b18dcf None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:08:54.480962 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-0afcdec4-1356-4123-8811-028722b18dcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:08:54.488679 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 491/969] 10.222.0.136 () {58 vars in 1028 bytes} [Thu Jul 14 17:08:54 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:08:54.528604 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f708b08-f815-4719-8005-0236f7ea6a03 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:08:54.539457 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f708b08-f815-4719-8005-0236f7ea6a03 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:08:54.544489 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a867e675-7ce4-4efb-9e7e-2beffc89b7bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8c6871e11f047e284afdb16bcb1d3a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd57eaa6dbca24cbb99dce1fe3437ecae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:08:54.545153 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a867e675-7ce4-4efb-9e7e-2beffc89b7bc service neutron] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:08:54.545439 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a867e675-7ce4-4efb-9e7e-2beffc89b7bc service neutron] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:08:54.545753 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a867e675-7ce4-4efb-9e7e-2beffc89b7bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:08:54.555417 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a867e675-7ce4-4efb-9e7e-2beffc89b7bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:08:54.557578 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a867e675-7ce4-4efb-9e7e-2beffc89b7bc service neutron] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:08:54.567544 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 479/970] 10.222.0.136 () {60 vars in 1370 bytes} [Thu Jul 14 17:08:54 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:09:00.035305 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001746dd-3711-41a0-bb01-b7f370cbfa09 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:09:00.036164 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001746dd-3711-41a0-bb01-b7f370cbfa09 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:09:00.036621 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001746dd-3711-41a0-bb01-b7f370cbfa09 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:09:00.041306 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 492/971] 10.222.0.136 () {54 vars in 926 bytes} [Thu Jul 14 17:09:00 2022] GET /identity => generated 271 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:09:00.046688 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecec6de-8e99-461f-9971-a6858260f26d None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:09:00.048361 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecec6de-8e99-461f-9971-a6858260f26d None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:09:00.048803 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecec6de-8e99-461f-9971-a6858260f26d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:09:00.098464 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-1ecec6de-8e99-461f-9971-a6858260f26d None None] MFA Rules not processed for user `05cdf81bd7d14730962816677457e858`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:09:00.100141 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-1ecec6de-8e99-461f-9971-a6858260f26d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:09:00.189162 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 480/972] 10.222.0.136 () {58 vars in 1023 bytes} [Thu Jul 14 17:09:00 2022] POST /identity/v3/auth/tokens => generated 2866 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:09:04.473134 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=2 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:09:04.928486 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5236d4a6-ba08-4089-a84b-4204c43ccd7b None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:09:04.928996 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5236d4a6-ba08-4089-a84b-4204c43ccd7b None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:09:04.929377 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5236d4a6-ba08-4089-a84b-4204c43ccd7b None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:09:04.931442 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 493/973] 10.222.0.136 () {54 vars in 926 bytes} [Thu Jul 14 17:09:04 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:09:04.936922 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a509d272-a217-4512-9824-866abdc0504d None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:09:04.937407 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a509d272-a217-4512-9824-866abdc0504d None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:09:04.937489 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a509d272-a217-4512-9824-866abdc0504d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:09:04.957463 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-a509d272-a217-4512-9824-866abdc0504d None None] MFA Rules not processed for user `05cdf81bd7d14730962816677457e858`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:09:04.958806 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-a509d272-a217-4512-9824-866abdc0504d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:09:04.968730 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 481/974] 10.222.0.136 () {58 vars in 1023 bytes} [Thu Jul 14 17:09:04 2022] POST /identity/v3/auth/tokens => generated 2866 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:09:06.617000 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbccbf8-2b27-4364-ad8a-714c49312ce6 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:09:06.617664 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbccbf8-2b27-4364-ad8a-714c49312ce6 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:09:06.617664 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbccbf8-2b27-4364-ad8a-714c49312ce6 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:09:06.619562 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 494/975] 10.222.0.136 () {54 vars in 926 bytes} [Thu Jul 14 17:09:06 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:09:06.625476 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3513a7-567b-4ad4-a42a-46c9ab896ea2 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:09:06.625966 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3513a7-567b-4ad4-a42a-46c9ab896ea2 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:09:06.626213 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3513a7-567b-4ad4-a42a-46c9ab896ea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:09:06.644655 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-0c3513a7-567b-4ad4-a42a-46c9ab896ea2 None None] MFA Rules not processed for user `05cdf81bd7d14730962816677457e858`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:09:06.646015 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-0c3513a7-567b-4ad4-a42a-46c9ab896ea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:09:06.655518 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 482/976] 10.222.0.136 () {58 vars in 1023 bytes} [Thu Jul 14 17:09:06 2022] POST /identity/v3/auth/tokens => generated 2866 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 17:09:10.699025 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86bc37a-9e4c-4d48-ad29-3f0efb6c183d None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:09:10.699693 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86bc37a-9e4c-4d48-ad29-3f0efb6c183d None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:09:10.700167 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86bc37a-9e4c-4d48-ad29-3f0efb6c183d None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:09:10.707093 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 495/977] 10.222.0.136 () {54 vars in 931 bytes} [Thu Jul 14 17:09:10 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:09:10.709691 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adf01b1-c17f-4edd-a1d7-0d28d5a19956 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:09:10.710174 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adf01b1-c17f-4edd-a1d7-0d28d5a19956 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:09:10.710849 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adf01b1-c17f-4edd-a1d7-0d28d5a19956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:09:10.719463 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=69 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:09:10.736706 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-6adf01b1-c17f-4edd-a1d7-0d28d5a19956 None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:09:10.738234 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-6adf01b1-c17f-4edd-a1d7-0d28d5a19956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:09:10.752329 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 483/978] 10.222.0.136 () {58 vars in 1028 bytes} [Thu Jul 14 17:09:10 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 17:09:10.819088 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70524fe5-9123-4036-9745-1b67fe6eb134 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:09:10.819674 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70524fe5-9123-4036-9745-1b67fe6eb134 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:09:10.820145 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70524fe5-9123-4036-9745-1b67fe6eb134 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:09:10.822643 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 496/979] 10.222.0.136 () {54 vars in 966 bytes} [Thu Jul 14 17:09:10 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:09:10.835296 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e51f7f1-6e7b-4261-b5a6-de32d2a45e43 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:09:10.836171 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e51f7f1-6e7b-4261-b5a6-de32d2a45e43 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:09:10.837787 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e51f7f1-6e7b-4261-b5a6-de32d2a45e43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:09:10.885755 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-2e51f7f1-6e7b-4261-b5a6-de32d2a45e43 None None] MFA Rules not processed for user `bc2b7d015c2046ddacac6e682f22d0f5`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:09:10.886954 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-2e51f7f1-6e7b-4261-b5a6-de32d2a45e43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:09:10.961606 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 484/980] 10.222.0.136 () {58 vars in 1063 bytes} [Thu Jul 14 17:09:10 2022] POST /identity/v3/auth/tokens => generated 2861 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 17:09:10.969901 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70524fe5-9123-4036-9745-1b67fe6eb134 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:09:10.984263 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70524fe5-9123-4036-9745-1b67fe6eb134 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:09:10.989128 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b632d380-ba91-4efe-b94c-bd4707bb5ce7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc2b7d015c2046ddacac6e682f22d0f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd57eaa6dbca24cbb99dce1fe3437ecae', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:09:10.989796 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b632d380-ba91-4efe-b94c-bd4707bb5ce7 service nova] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:09:10.990085 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b632d380-ba91-4efe-b94c-bd4707bb5ce7 service nova] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:09:10.990373 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b632d380-ba91-4efe-b94c-bd4707bb5ce7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:09:10.999027 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b632d380-ba91-4efe-b94c-bd4707bb5ce7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:09:11.000649 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b632d380-ba91-4efe-b94c-bd4707bb5ce7 service nova] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:09:11.010983 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 497/981] 10.222.0.136 () {60 vars in 1370 bytes} [Thu Jul 14 17:09:10 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:09:13.539502 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45655c5f-4667-4d0c-be11-4e414ff0bf96 None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:09:13.540643 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45655c5f-4667-4d0c-be11-4e414ff0bf96 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:09:13.540729 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45655c5f-4667-4d0c-be11-4e414ff0bf96 None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:09:13.542531 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 485/982] 10.222.0.136 () {54 vars in 931 bytes} [Thu Jul 14 17:09:13 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:09:13.548399 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e79d9a-ccdb-4171-8b86-3c14665f7e24 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:09:13.548939 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e79d9a-ccdb-4171-8b86-3c14665f7e24 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:09:13.548939 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e79d9a-ccdb-4171-8b86-3c14665f7e24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:09:13.569101 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-a5e79d9a-ccdb-4171-8b86-3c14665f7e24 None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:09:13.570658 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-a5e79d9a-ccdb-4171-8b86-3c14665f7e24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:09:13.579081 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 498/983] 10.222.0.136 () {58 vars in 1028 bytes} [Thu Jul 14 17:09:13 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:09:13.630784 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45655c5f-4667-4d0c-be11-4e414ff0bf96 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:09:13.645078 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45655c5f-4667-4d0c-be11-4e414ff0bf96 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:09:13.651032 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a299d80-8a9d-437a-822f-f885cd9a7044 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc2b7d015c2046ddacac6e682f22d0f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd57eaa6dbca24cbb99dce1fe3437ecae', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:09:13.651764 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a299d80-8a9d-437a-822f-f885cd9a7044 service nova] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:09:13.652131 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a299d80-8a9d-437a-822f-f885cd9a7044 service nova] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:09:13.652481 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a299d80-8a9d-437a-822f-f885cd9a7044 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:09:13.661060 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a299d80-8a9d-437a-822f-f885cd9a7044 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:09:13.662748 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a299d80-8a9d-437a-822f-f885cd9a7044 service nova] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:09:13.674139 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 486/984] 10.222.0.136 () {60 vars in 1370 bytes} [Thu Jul 14 17:09:13 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:09:16.287452 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7b0e63-ad54-4006-a6fa-ca6f45fb1fba None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:09:16.288000 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7b0e63-ad54-4006-a6fa-ca6f45fb1fba None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:09:16.288000 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7b0e63-ad54-4006-a6fa-ca6f45fb1fba None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:09:16.289355 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 499/985] 10.222.0.136 () {54 vars in 931 bytes} [Thu Jul 14 17:09:16 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:09:16.294779 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf3d702-c145-4426-a73c-829190de348a None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:09:16.295202 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf3d702-c145-4426-a73c-829190de348a None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:09:16.295372 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf3d702-c145-4426-a73c-829190de348a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:09:16.313615 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-4cf3d702-c145-4426-a73c-829190de348a None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:09:16.314800 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-4cf3d702-c145-4426-a73c-829190de348a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:09:16.323206 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 487/986] 10.222.0.136 () {58 vars in 1028 bytes} [Thu Jul 14 17:09:16 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 17:09:16.370631 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5443920-f177-41e6-b6ff-b08684bb7c49 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:09:16.370921 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5443920-f177-41e6-b6ff-b08684bb7c49 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:09:16.371201 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5443920-f177-41e6-b6ff-b08684bb7c49 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:09:16.372551 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 500/987] 10.222.0.136 () {54 vars in 966 bytes} [Thu Jul 14 17:09:16 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:09:16.379644 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b454483c-4172-4b8b-b57e-cd17fe153b66 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:09:16.379644 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b454483c-4172-4b8b-b57e-cd17fe153b66 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:09:16.379644 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b454483c-4172-4b8b-b57e-cd17fe153b66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:09:16.398641 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-b454483c-4172-4b8b-b57e-cd17fe153b66 None None] MFA Rules not processed for user `bc2b7d015c2046ddacac6e682f22d0f5`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:09:16.400810 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-b454483c-4172-4b8b-b57e-cd17fe153b66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:09:16.409304 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 488/988] 10.222.0.136 () {58 vars in 1063 bytes} [Thu Jul 14 17:09:16 2022] POST /identity/v3/auth/tokens => generated 2861 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:09:16.417708 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5443920-f177-41e6-b6ff-b08684bb7c49 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:09:16.432770 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5443920-f177-41e6-b6ff-b08684bb7c49 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:09:16.445836 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2c2bf2-018d-43fd-bcb2-d5f0503d1733 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc2b7d015c2046ddacac6e682f22d0f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd57eaa6dbca24cbb99dce1fe3437ecae', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:09:16.447486 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2c2bf2-018d-43fd-bcb2-d5f0503d1733 service nova] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:09:16.448074 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2c2bf2-018d-43fd-bcb2-d5f0503d1733 service nova] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:09:16.448617 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2c2bf2-018d-43fd-bcb2-d5f0503d1733 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:09:16.459370 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2c2bf2-018d-43fd-bcb2-d5f0503d1733 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:09:16.461276 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2c2bf2-018d-43fd-bcb2-d5f0503d1733 service nova] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:09:16.472656 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 501/989] 10.222.0.136 () {60 vars in 1370 bytes} [Thu Jul 14 17:09:16 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:09:18.844733 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b41290-ddcf-4cc6-a976-b83fd3164c10 None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:09:18.845586 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b41290-ddcf-4cc6-a976-b83fd3164c10 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:09:18.846021 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b41290-ddcf-4cc6-a976-b83fd3164c10 None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:09:18.848700 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 489/990] 10.222.0.136 () {54 vars in 931 bytes} [Thu Jul 14 17:09:18 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:09:18.855047 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9517f111-178e-4747-a769-9999f60c0015 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:09:18.855827 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9517f111-178e-4747-a769-9999f60c0015 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:09:18.856263 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9517f111-178e-4747-a769-9999f60c0015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:09:18.876729 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-9517f111-178e-4747-a769-9999f60c0015 None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:09:18.878335 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-9517f111-178e-4747-a769-9999f60c0015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:09:18.898082 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 502/991] 10.222.0.136 () {58 vars in 1028 bytes} [Thu Jul 14 17:09:18 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:09:18.937823 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b41290-ddcf-4cc6-a976-b83fd3164c10 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:09:18.953236 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b41290-ddcf-4cc6-a976-b83fd3164c10 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:09:18.958851 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65fe0a9-db3a-4d95-a8bd-108bff7b6a03 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc2b7d015c2046ddacac6e682f22d0f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd57eaa6dbca24cbb99dce1fe3437ecae', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:09:18.959867 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65fe0a9-db3a-4d95-a8bd-108bff7b6a03 service nova] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:09:18.960310 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65fe0a9-db3a-4d95-a8bd-108bff7b6a03 service nova] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:09:18.960768 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65fe0a9-db3a-4d95-a8bd-108bff7b6a03 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:09:18.971457 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65fe0a9-db3a-4d95-a8bd-108bff7b6a03 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:09:18.973313 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65fe0a9-db3a-4d95-a8bd-108bff7b6a03 service nova] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:09:18.999074 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 490/992] 10.222.0.136 () {60 vars in 1370 bytes} [Thu Jul 14 17:09:18 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 17:09:21.095230 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d5b366-f332-494d-b058-011bb69a9a89 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:09:21.095683 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d5b366-f332-494d-b058-011bb69a9a89 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:09:21.095767 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d5b366-f332-494d-b058-011bb69a9a89 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:09:21.097857 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 503/993] 10.222.0.136 () {54 vars in 931 bytes} [Thu Jul 14 17:09:21 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:09:21.103912 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4230d7d9-48a8-41b3-b3f8-eeee9a66713d None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:09:21.104810 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4230d7d9-48a8-41b3-b3f8-eeee9a66713d None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:09:21.105303 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4230d7d9-48a8-41b3-b3f8-eeee9a66713d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:09:21.131339 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-4230d7d9-48a8-41b3-b3f8-eeee9a66713d None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:09:21.135901 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-4230d7d9-48a8-41b3-b3f8-eeee9a66713d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:09:21.156934 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 491/994] 10.222.0.136 () {58 vars in 1028 bytes} [Thu Jul 14 17:09:21 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:09:21.475262 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9efb924-6440-46e9-8180-4223eebcb4a0 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:09:21.475651 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9efb924-6440-46e9-8180-4223eebcb4a0 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:09:21.476016 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9efb924-6440-46e9-8180-4223eebcb4a0 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:09:21.478186 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 504/995] 10.222.0.136 () {54 vars in 968 bytes} [Thu Jul 14 17:09:21 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:09:21.483354 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d6f240-30d0-4699-a3ea-1ce1670e580e None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:09:21.483748 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d6f240-30d0-4699-a3ea-1ce1670e580e None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:09:21.484112 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d6f240-30d0-4699-a3ea-1ce1670e580e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:09:21.496839 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56027ac7-f5f0-4246-a8d6-dbd8128ebcbb None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:09:21.496839 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56027ac7-f5f0-4246-a8d6-dbd8128ebcbb None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:09:21.496839 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56027ac7-f5f0-4246-a8d6-dbd8128ebcbb None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:09:21.498326 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 505/996] 10.222.0.136 () {54 vars in 931 bytes} [Thu Jul 14 17:09:21 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:09:21.503282 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dc3ff7-2850-400e-9362-d19aa14be2a5 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:09:21.503581 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dc3ff7-2850-400e-9362-d19aa14be2a5 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:09:21.503866 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dc3ff7-2850-400e-9362-d19aa14be2a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:09:21.522453 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-23dc3ff7-2850-400e-9362-d19aa14be2a5 None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:09:21.523667 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-23dc3ff7-2850-400e-9362-d19aa14be2a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:09:21.525053 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-61d6f240-30d0-4699-a3ea-1ce1670e580e None None] MFA Rules not processed for user `5fc301707c5d4f759b61266af952e625`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:09:21.526198 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-61d6f240-30d0-4699-a3ea-1ce1670e580e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:09:21.532696 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 506/997] 10.222.0.136 () {58 vars in 1028 bytes} [Thu Jul 14 17:09:21 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 17:09:21.580060 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dc3ff7-2850-400e-9362-d19aa14be2a5 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:09:21.592646 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 492/998] 10.222.0.136 () {58 vars in 1065 bytes} [Thu Jul 14 17:09:21 2022] POST /identity/v3/auth/tokens => generated 2678 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:09:21.594978 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dc3ff7-2850-400e-9362-d19aa14be2a5 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:09:21.600502 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d6f240-30d0-4699-a3ea-1ce1670e580e None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:09:21.600913 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019c3851-a13f-4e54-8850-21f7c2e5e33c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc2b7d015c2046ddacac6e682f22d0f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd57eaa6dbca24cbb99dce1fe3437ecae', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:09:21.601585 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019c3851-a13f-4e54-8850-21f7c2e5e33c service nova] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:09:21.601882 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019c3851-a13f-4e54-8850-21f7c2e5e33c service nova] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:09:21.602203 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019c3851-a13f-4e54-8850-21f7c2e5e33c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:09:21.608596 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d6f240-30d0-4699-a3ea-1ce1670e580e None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:09:21.612042 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019c3851-a13f-4e54-8850-21f7c2e5e33c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:09:21.612226 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2349e39-0bfc-4f42-9d40-2b090274ddcc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fc301707c5d4f759b61266af952e625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd57eaa6dbca24cbb99dce1fe3437ecae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:09:21.613062 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2349e39-0bfc-4f42-9d40-2b090274ddcc service cinder] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:09:21.613349 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2349e39-0bfc-4f42-9d40-2b090274ddcc service cinder] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:09:21.613656 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2349e39-0bfc-4f42-9d40-2b090274ddcc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:09:21.613819 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019c3851-a13f-4e54-8850-21f7c2e5e33c service nova] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:09:21.623663 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2349e39-0bfc-4f42-9d40-2b090274ddcc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:09:21.625098 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2349e39-0bfc-4f42-9d40-2b090274ddcc service cinder] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:09:21.629212 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:09:21.629840 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 507/999] 10.222.0.136 () {60 vars in 1370 bytes} [Thu Jul 14 17:09:21 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 17:09:21.641055 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 493/1000] 10.222.0.136 () {60 vars in 1370 bytes} [Thu Jul 14 17:09:21 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 17:09:24.035998 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41d4b7f-91b5-4761-a6c9-e6ffd7f36b42 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:09:24.036512 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41d4b7f-91b5-4761-a6c9-e6ffd7f36b42 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:09:24.036613 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41d4b7f-91b5-4761-a6c9-e6ffd7f36b42 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:09:24.038240 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 508/1001] 10.222.0.136 () {54 vars in 931 bytes} [Thu Jul 14 17:09:24 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:09:24.044072 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a2f207-c1c4-4faa-8b12-477281e7d792 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:09:24.044490 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a2f207-c1c4-4faa-8b12-477281e7d792 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:09:24.044640 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a2f207-c1c4-4faa-8b12-477281e7d792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:09:24.063527 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-a6a2f207-c1c4-4faa-8b12-477281e7d792 None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:09:24.064723 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-a6a2f207-c1c4-4faa-8b12-477281e7d792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:09:24.072816 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 494/1002] 10.222.0.136 () {58 vars in 1028 bytes} [Thu Jul 14 17:09:24 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:09:24.120414 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41d4b7f-91b5-4761-a6c9-e6ffd7f36b42 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:09:24.137850 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41d4b7f-91b5-4761-a6c9-e6ffd7f36b42 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:09:24.142799 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db109e9a-29cc-4f71-bf29-8c4dd6dbf7cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc2b7d015c2046ddacac6e682f22d0f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd57eaa6dbca24cbb99dce1fe3437ecae', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:09:24.143894 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db109e9a-29cc-4f71-bf29-8c4dd6dbf7cd service nova] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:09:24.143894 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db109e9a-29cc-4f71-bf29-8c4dd6dbf7cd service nova] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:09:24.144115 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db109e9a-29cc-4f71-bf29-8c4dd6dbf7cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:09:24.153584 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db109e9a-29cc-4f71-bf29-8c4dd6dbf7cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:09:24.155170 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db109e9a-29cc-4f71-bf29-8c4dd6dbf7cd service nova] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:09:24.165202 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 509/1003] 10.222.0.136 () {60 vars in 1370 bytes} [Thu Jul 14 17:09:24 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:09:26.516113 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd2cf1f-0561-4c7d-b7a0-9f2e850b1d45 None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:09:26.516644 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd2cf1f-0561-4c7d-b7a0-9f2e850b1d45 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:09:26.516644 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd2cf1f-0561-4c7d-b7a0-9f2e850b1d45 None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:09:26.517988 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 495/1004] 10.222.0.136 () {54 vars in 931 bytes} [Thu Jul 14 17:09:26 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:09:26.523248 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de11d30-d093-44c8-9a71-bd40a4e0f3b2 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:09:26.523688 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de11d30-d093-44c8-9a71-bd40a4e0f3b2 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:09:26.524367 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de11d30-d093-44c8-9a71-bd40a4e0f3b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:09:26.543112 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-0de11d30-d093-44c8-9a71-bd40a4e0f3b2 None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:09:26.544297 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-0de11d30-d093-44c8-9a71-bd40a4e0f3b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:09:26.552237 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 510/1005] 10.222.0.136 () {58 vars in 1028 bytes} [Thu Jul 14 17:09:26 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:09:26.597042 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd2cf1f-0561-4c7d-b7a0-9f2e850b1d45 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:09:26.612545 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd2cf1f-0561-4c7d-b7a0-9f2e850b1d45 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:09:26.618370 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4517eb7-6c13-4986-9f52-4e0555909d44 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc2b7d015c2046ddacac6e682f22d0f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd57eaa6dbca24cbb99dce1fe3437ecae', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:09:26.619014 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4517eb7-6c13-4986-9f52-4e0555909d44 service nova] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:09:26.619305 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4517eb7-6c13-4986-9f52-4e0555909d44 service nova] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:09:26.619588 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4517eb7-6c13-4986-9f52-4e0555909d44 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:09:26.628379 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4517eb7-6c13-4986-9f52-4e0555909d44 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:09:26.630004 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4517eb7-6c13-4986-9f52-4e0555909d44 service nova] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:09:26.640895 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 496/1006] 10.222.0.136 () {60 vars in 1370 bytes} [Thu Jul 14 17:09:26 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:09:28.951833 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28bd4b9-9ecb-421e-a3bf-cfe9db9c8ee6 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:09:28.952710 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28bd4b9-9ecb-421e-a3bf-cfe9db9c8ee6 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:09:28.952994 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28bd4b9-9ecb-421e-a3bf-cfe9db9c8ee6 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:09:28.954578 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 511/1007] 10.222.0.136 () {54 vars in 931 bytes} [Thu Jul 14 17:09:28 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:09:28.959766 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391486ed-6f8a-4165-8ff9-ef227b0b047b None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:09:28.960206 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391486ed-6f8a-4165-8ff9-ef227b0b047b None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:09:28.960339 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391486ed-6f8a-4165-8ff9-ef227b0b047b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:09:28.980650 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-391486ed-6f8a-4165-8ff9-ef227b0b047b None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:09:28.982305 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-391486ed-6f8a-4165-8ff9-ef227b0b047b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:09:28.990848 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 497/1008] 10.222.0.136 () {58 vars in 1028 bytes} [Thu Jul 14 17:09:28 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:09:29.037207 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28bd4b9-9ecb-421e-a3bf-cfe9db9c8ee6 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:09:29.051660 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28bd4b9-9ecb-421e-a3bf-cfe9db9c8ee6 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:09:29.057410 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1445a0-f040-46d7-a438-5f39590c8eba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc2b7d015c2046ddacac6e682f22d0f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd57eaa6dbca24cbb99dce1fe3437ecae', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:09:29.058103 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1445a0-f040-46d7-a438-5f39590c8eba service nova] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:09:29.058384 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1445a0-f040-46d7-a438-5f39590c8eba service nova] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:09:29.058657 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1445a0-f040-46d7-a438-5f39590c8eba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:09:29.067225 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1445a0-f040-46d7-a438-5f39590c8eba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:09:29.068821 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1445a0-f040-46d7-a438-5f39590c8eba service nova] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:09:29.080598 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 512/1009] 10.222.0.136 () {60 vars in 1370 bytes} [Thu Jul 14 17:09:29 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:09:31.481867 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71431388-0d0e-4f68-b2dc-1d33cac97e89 None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:09:31.482372 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71431388-0d0e-4f68-b2dc-1d33cac97e89 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:09:31.482372 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71431388-0d0e-4f68-b2dc-1d33cac97e89 None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:09:31.483832 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 498/1010] 10.222.0.136 () {54 vars in 931 bytes} [Thu Jul 14 17:09:31 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:09:31.489214 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c27b91-dcb6-439c-a784-062913591519 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:09:31.489813 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c27b91-dcb6-439c-a784-062913591519 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:09:31.489813 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c27b91-dcb6-439c-a784-062913591519 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:09:31.511797 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-20c27b91-dcb6-439c-a784-062913591519 None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:09:31.513266 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-20c27b91-dcb6-439c-a784-062913591519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:09:31.522595 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 513/1011] 10.222.0.136 () {58 vars in 1028 bytes} [Thu Jul 14 17:09:31 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:09:31.575554 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71431388-0d0e-4f68-b2dc-1d33cac97e89 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:09:31.589985 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71431388-0d0e-4f68-b2dc-1d33cac97e89 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:09:31.595212 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1246206-b80b-4fbd-9e8f-21a4771186ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc2b7d015c2046ddacac6e682f22d0f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd57eaa6dbca24cbb99dce1fe3437ecae', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:09:31.595889 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1246206-b80b-4fbd-9e8f-21a4771186ad service nova] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:09:31.596190 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1246206-b80b-4fbd-9e8f-21a4771186ad service nova] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:09:31.596493 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1246206-b80b-4fbd-9e8f-21a4771186ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:09:31.606483 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1246206-b80b-4fbd-9e8f-21a4771186ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:09:31.608077 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1246206-b80b-4fbd-9e8f-21a4771186ad service nova] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:09:31.618442 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 499/1012] 10.222.0.136 () {60 vars in 1370 bytes} [Thu Jul 14 17:09:31 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:09:34.110887 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5f787f-de86-4874-857d-a72f89d713ba None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:09:34.111588 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5f787f-de86-4874-857d-a72f89d713ba None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:09:34.111588 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5f787f-de86-4874-857d-a72f89d713ba None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:09:34.113365 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 514/1013] 10.222.0.136 () {54 vars in 931 bytes} [Thu Jul 14 17:09:34 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:09:34.119450 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9e1157-8076-4edc-b852-92de94728cbf None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:09:34.120012 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9e1157-8076-4edc-b852-92de94728cbf None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:09:34.120012 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9e1157-8076-4edc-b852-92de94728cbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:09:34.139492 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-5c9e1157-8076-4edc-b852-92de94728cbf None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:09:34.140805 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-5c9e1157-8076-4edc-b852-92de94728cbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:09:34.150324 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 500/1014] 10.222.0.136 () {58 vars in 1028 bytes} [Thu Jul 14 17:09:34 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:09:34.207800 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5f787f-de86-4874-857d-a72f89d713ba None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:09:34.228271 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5f787f-de86-4874-857d-a72f89d713ba None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:09:34.234664 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacfebb7-1a76-459e-8788-1f59205cc3bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc2b7d015c2046ddacac6e682f22d0f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd57eaa6dbca24cbb99dce1fe3437ecae', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:09:34.235519 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacfebb7-1a76-459e-8788-1f59205cc3bc service nova] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:09:34.235881 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacfebb7-1a76-459e-8788-1f59205cc3bc service nova] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:09:34.236239 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacfebb7-1a76-459e-8788-1f59205cc3bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:09:34.248022 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacfebb7-1a76-459e-8788-1f59205cc3bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:09:34.250036 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacfebb7-1a76-459e-8788-1f59205cc3bc service nova] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:09:34.263910 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 515/1015] 10.222.0.136 () {60 vars in 1370 bytes} [Thu Jul 14 17:09:34 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:09:37.146376 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130e959a-54cc-4e5e-9bda-a31a90511ce6 None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:09:37.147007 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130e959a-54cc-4e5e-9bda-a31a90511ce6 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:09:37.147007 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130e959a-54cc-4e5e-9bda-a31a90511ce6 None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:09:37.148313 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 501/1016] 10.222.0.136 () {54 vars in 931 bytes} [Thu Jul 14 17:09:37 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:09:37.154230 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9711af3-d4b9-4d74-98d4-7d1460b297bb None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:09:37.154716 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9711af3-d4b9-4d74-98d4-7d1460b297bb None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:09:37.154897 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9711af3-d4b9-4d74-98d4-7d1460b297bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:09:37.161957 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=52 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:09:37.175510 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-c9711af3-d4b9-4d74-98d4-7d1460b297bb None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:09:37.176686 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-c9711af3-d4b9-4d74-98d4-7d1460b297bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:09:37.184663 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 516/1017] 10.222.0.136 () {58 vars in 1028 bytes} [Thu Jul 14 17:09:37 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:09:37.237170 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130e959a-54cc-4e5e-9bda-a31a90511ce6 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:09:37.252069 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130e959a-54cc-4e5e-9bda-a31a90511ce6 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:09:37.257065 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b025b3-5fe1-4fcb-b61e-b6c3e104cb78 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc2b7d015c2046ddacac6e682f22d0f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd57eaa6dbca24cbb99dce1fe3437ecae', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:09:37.258415 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b025b3-5fe1-4fcb-b61e-b6c3e104cb78 service nova] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:09:37.258981 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b025b3-5fe1-4fcb-b61e-b6c3e104cb78 service nova] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:09:37.259099 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b025b3-5fe1-4fcb-b61e-b6c3e104cb78 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:09:37.267841 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b025b3-5fe1-4fcb-b61e-b6c3e104cb78 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:09:37.269424 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b025b3-5fe1-4fcb-b61e-b6c3e104cb78 service nova] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:09:37.279773 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 502/1018] 10.222.0.136 () {60 vars in 1370 bytes} [Thu Jul 14 17:09:37 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 17:09:37.903875 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd399aba-3329-4b05-a709-24ef4a2fe333 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:09:37.904166 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd399aba-3329-4b05-a709-24ef4a2fe333 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:09:37.904447 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd399aba-3329-4b05-a709-24ef4a2fe333 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:09:37.905844 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 517/1019] 10.222.0.136 () {54 vars in 931 bytes} [Thu Jul 14 17:09:37 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:09:37.911026 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ea8a21-c528-48b1-9703-c123950e3a16 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:09:37.911329 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ea8a21-c528-48b1-9703-c123950e3a16 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:09:37.911618 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ea8a21-c528-48b1-9703-c123950e3a16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:09:37.930226 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-79ea8a21-c528-48b1-9703-c123950e3a16 None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:09:37.931762 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-79ea8a21-c528-48b1-9703-c123950e3a16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:09:37.939850 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 503/1020] 10.222.0.136 () {58 vars in 1028 bytes} [Thu Jul 14 17:09:37 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:09:38.000090 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a224014-2b67-4f6c-9f79-54aad9979321 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:09:38.000382 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a224014-2b67-4f6c-9f79-54aad9979321 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:09:38.000666 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a224014-2b67-4f6c-9f79-54aad9979321 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:09:38.002093 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 518/1021] 10.222.0.136 () {54 vars in 967 bytes} [Thu Jul 14 17:09:37 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:09:38.007280 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e382f5-b325-43fe-a75c-fdb984a98f48 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:09:38.007702 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e382f5-b325-43fe-a75c-fdb984a98f48 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:09:38.008674 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e382f5-b325-43fe-a75c-fdb984a98f48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:09:38.047424 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-71e382f5-b325-43fe-a75c-fdb984a98f48 None None] MFA Rules not processed for user `c2c3d46d376c460a99426a5dc7c66115`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:09:38.048754 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-71e382f5-b325-43fe-a75c-fdb984a98f48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:09:38.114695 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 504/1022] 10.222.0.136 () {58 vars in 1064 bytes} [Thu Jul 14 17:09:38 2022] POST /identity/v3/auth/tokens => generated 2678 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:09:38.123214 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a224014-2b67-4f6c-9f79-54aad9979321 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:09:38.133890 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a224014-2b67-4f6c-9f79-54aad9979321 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:09:38.137325 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eb840a-f8a1-48da-a5dc-4b333f6832f4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c3d46d376c460a99426a5dc7c66115', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd57eaa6dbca24cbb99dce1fe3437ecae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:09:38.138017 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eb840a-f8a1-48da-a5dc-4b333f6832f4 service glance] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:09:38.138289 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eb840a-f8a1-48da-a5dc-4b333f6832f4 service glance] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:09:38.138566 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eb840a-f8a1-48da-a5dc-4b333f6832f4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:09:38.147493 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8eb840a-f8a1-48da-a5dc-4b333f6832f4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:09:38.149062 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8eb840a-f8a1-48da-a5dc-4b333f6832f4 service glance] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:09:38.158425 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 519/1023] 10.222.0.136 () {60 vars in 1370 bytes} [Thu Jul 14 17:09:38 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:09:39.636173 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf8e6fa-4664-41d7-ade2-92e953faf3c1 None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:09:39.636872 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf8e6fa-4664-41d7-ade2-92e953faf3c1 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:09:39.636872 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf8e6fa-4664-41d7-ade2-92e953faf3c1 None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:09:39.638200 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 505/1024] 10.222.0.136 () {54 vars in 931 bytes} [Thu Jul 14 17:09:39 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:09:39.643540 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0611e168-8c2a-409c-99a5-2f0f9250e6ff None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:09:39.644052 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0611e168-8c2a-409c-99a5-2f0f9250e6ff None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:09:39.644161 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0611e168-8c2a-409c-99a5-2f0f9250e6ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:09:39.663698 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-0611e168-8c2a-409c-99a5-2f0f9250e6ff None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:09:39.665795 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-0611e168-8c2a-409c-99a5-2f0f9250e6ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:09:39.673746 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 520/1025] 10.222.0.136 () {58 vars in 1028 bytes} [Thu Jul 14 17:09:39 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:09:39.722560 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf8e6fa-4664-41d7-ade2-92e953faf3c1 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:09:39.736938 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf8e6fa-4664-41d7-ade2-92e953faf3c1 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:09:39.741863 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a870f75b-ffdf-4166-8c8e-fcdf3a49eb0b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc2b7d015c2046ddacac6e682f22d0f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd57eaa6dbca24cbb99dce1fe3437ecae', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:09:39.744028 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a870f75b-ffdf-4166-8c8e-fcdf3a49eb0b service nova] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:09:39.744028 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a870f75b-ffdf-4166-8c8e-fcdf3a49eb0b service nova] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:09:39.744667 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a870f75b-ffdf-4166-8c8e-fcdf3a49eb0b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:09:39.757395 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a870f75b-ffdf-4166-8c8e-fcdf3a49eb0b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:09:39.759059 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a870f75b-ffdf-4166-8c8e-fcdf3a49eb0b service nova] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:09:39.769833 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 506/1026] 10.222.0.136 () {60 vars in 1370 bytes} [Thu Jul 14 17:09:39 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:09:49.658245 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=11 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:09:49.765585 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=70 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:09:53.503238 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96386cb-ad66-4e11-a80d-6a78c175fddd None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:09:53.503805 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96386cb-ad66-4e11-a80d-6a78c175fddd None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:09:53.503805 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96386cb-ad66-4e11-a80d-6a78c175fddd None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:09:53.505113 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 521/1027] 10.222.0.136 () {54 vars in 923 bytes} [Thu Jul 14 17:09:53 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:09:53.511683 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f31d93-48d1-42e2-9bdc-a94b7636fb4a None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:09:53.512179 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f31d93-48d1-42e2-9bdc-a94b7636fb4a None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:09:53.512292 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f31d93-48d1-42e2-9bdc-a94b7636fb4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:09:53.530195 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-c8f31d93-48d1-42e2-9bdc-a94b7636fb4a None None] MFA Rules not processed for user `05cdf81bd7d14730962816677457e858`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:09:53.534540 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-c8f31d93-48d1-42e2-9bdc-a94b7636fb4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:09:53.543161 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 507/1028] 10.222.0.136 () {58 vars in 1020 bytes} [Thu Jul 14 17:09:53 2022] POST /identity/v3/auth/tokens => generated 2866 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:09:53.557850 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64d0767-9be5-4407-af4c-a2c5a431df37 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:09:53.558149 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64d0767-9be5-4407-af4c-a2c5a431df37 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:09:53.558437 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64d0767-9be5-4407-af4c-a2c5a431df37 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:09:53.559817 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 522/1029] 10.222.0.136 () {54 vars in 923 bytes} [Thu Jul 14 17:09:53 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:09:53.564220 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a77af92-b856-4214-9a80-e7adc4f7d1a2 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:09:53.564516 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a77af92-b856-4214-9a80-e7adc4f7d1a2 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:09:53.564800 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a77af92-b856-4214-9a80-e7adc4f7d1a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:09:53.583588 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-5a77af92-b856-4214-9a80-e7adc4f7d1a2 None None] MFA Rules not processed for user `bc2b7d015c2046ddacac6e682f22d0f5`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:09:53.584782 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-5a77af92-b856-4214-9a80-e7adc4f7d1a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:09:53.593473 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 508/1030] 10.222.0.136 () {58 vars in 1020 bytes} [Thu Jul 14 17:09:53 2022] POST /identity/v3/auth/tokens => generated 2861 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:09:56.360451 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57f71a8-a212-4e31-b151-747b8b71f5a2 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:09:56.361021 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57f71a8-a212-4e31-b151-747b8b71f5a2 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:09:56.361021 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57f71a8-a212-4e31-b151-747b8b71f5a2 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:09:56.362399 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 523/1031] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 17:09:56 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:09:56.367671 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5549c100-a367-4a68-ba80-e5c481a5697e None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:09:56.368117 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5549c100-a367-4a68-ba80-e5c481a5697e None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:09:56.368240 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5549c100-a367-4a68-ba80-e5c481a5697e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:09:56.386104 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-5549c100-a367-4a68-ba80-e5c481a5697e None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:09:56.387297 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-5549c100-a367-4a68-ba80-e5c481a5697e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:09:56.394953 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 509/1032] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 17:09:56 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:09:56.440130 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57f71a8-a212-4e31-b151-747b8b71f5a2 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:09:56.454893 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57f71a8-a212-4e31-b151-747b8b71f5a2 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:09:56.459779 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415df2f1-f7f6-4da0-8d3b-9b61f941b10d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc2b7d015c2046ddacac6e682f22d0f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd57eaa6dbca24cbb99dce1fe3437ecae', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:09:56.460423 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415df2f1-f7f6-4da0-8d3b-9b61f941b10d service nova] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:09:56.460710 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415df2f1-f7f6-4da0-8d3b-9b61f941b10d service nova] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:09:56.461622 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415df2f1-f7f6-4da0-8d3b-9b61f941b10d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:09:56.469993 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415df2f1-f7f6-4da0-8d3b-9b61f941b10d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:09:56.471510 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415df2f1-f7f6-4da0-8d3b-9b61f941b10d service nova] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:09:56.481158 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 524/1033] 10.222.0.136 () {60 vars in 1370 bytes} [Thu Jul 14 17:09:56 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:09:57.449258 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73dd834-8b83-4da4-8d6b-ffc19b0375de None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:09:57.449841 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73dd834-8b83-4da4-8d6b-ffc19b0375de None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:09:57.449841 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73dd834-8b83-4da4-8d6b-ffc19b0375de None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:09:57.451237 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 510/1034] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 17:09:57 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:09:57.456282 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6dd3ce-7d6e-4e90-a9a3-47adf366948d None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:09:57.456717 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6dd3ce-7d6e-4e90-a9a3-47adf366948d None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:09:57.456827 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6dd3ce-7d6e-4e90-a9a3-47adf366948d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:09:57.475546 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-8f6dd3ce-7d6e-4e90-a9a3-47adf366948d None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:09:57.476764 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-8f6dd3ce-7d6e-4e90-a9a3-47adf366948d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:09:57.484567 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 525/1035] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 17:09:57 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:09:57.673446 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73dd834-8b83-4da4-8d6b-ffc19b0375de None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:09:57.686702 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73dd834-8b83-4da4-8d6b-ffc19b0375de None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:09:57.691443 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3e02fd-ed3d-434a-979b-61122ed828ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc2b7d015c2046ddacac6e682f22d0f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd57eaa6dbca24cbb99dce1fe3437ecae', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:09:57.692074 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3e02fd-ed3d-434a-979b-61122ed828ef service nova] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:09:57.692356 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3e02fd-ed3d-434a-979b-61122ed828ef service nova] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:09:57.692634 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3e02fd-ed3d-434a-979b-61122ed828ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:09:57.701325 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3e02fd-ed3d-434a-979b-61122ed828ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:09:57.702926 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3e02fd-ed3d-434a-979b-61122ed828ef service nova] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:09:57.712725 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 511/1036] 10.222.0.136 () {60 vars in 1370 bytes} [Thu Jul 14 17:09:57 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:09:58.646964 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3f734f-73bd-4e5a-b3e1-1749a2ec4093 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:09:58.647532 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3f734f-73bd-4e5a-b3e1-1749a2ec4093 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:09:58.647532 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3f734f-73bd-4e5a-b3e1-1749a2ec4093 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:09:58.648968 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 526/1037] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 17:09:58 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:09:58.653884 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd836f92-e77a-4c97-b244-9e977028a4bd None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:09:58.654323 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd836f92-e77a-4c97-b244-9e977028a4bd None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:09:58.654432 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd836f92-e77a-4c97-b244-9e977028a4bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:09:58.672698 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-fd836f92-e77a-4c97-b244-9e977028a4bd None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:09:58.673934 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-fd836f92-e77a-4c97-b244-9e977028a4bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:09:58.683012 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 512/1038] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 17:09:58 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:09:58.845961 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3f734f-73bd-4e5a-b3e1-1749a2ec4093 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:09:58.859439 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3f734f-73bd-4e5a-b3e1-1749a2ec4093 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:09:58.864291 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ba056e-8dab-4149-aab6-3a5e9a876f10 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc2b7d015c2046ddacac6e682f22d0f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd57eaa6dbca24cbb99dce1fe3437ecae', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:09:58.864923 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ba056e-8dab-4149-aab6-3a5e9a876f10 service nova] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:09:58.865210 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ba056e-8dab-4149-aab6-3a5e9a876f10 service nova] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:09:58.865497 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ba056e-8dab-4149-aab6-3a5e9a876f10 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:09:58.873654 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ba056e-8dab-4149-aab6-3a5e9a876f10 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:09:58.875252 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ba056e-8dab-4149-aab6-3a5e9a876f10 service nova] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:09:58.885796 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 527/1039] 10.222.0.136 () {60 vars in 1370 bytes} [Thu Jul 14 17:09:58 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:09:59.764897 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7240be-1213-4d37-9be6-e84cbf07da5d None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:09:59.765442 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7240be-1213-4d37-9be6-e84cbf07da5d None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:09:59.765442 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7240be-1213-4d37-9be6-e84cbf07da5d None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:09:59.766880 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 513/1040] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 17:09:59 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:09:59.771883 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c0cf0d-56bd-4241-95ac-edc5f4a655e2 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:09:59.772301 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c0cf0d-56bd-4241-95ac-edc5f4a655e2 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:09:59.772455 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c0cf0d-56bd-4241-95ac-edc5f4a655e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:09:59.791870 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-e0c0cf0d-56bd-4241-95ac-edc5f4a655e2 None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:09:59.793093 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-e0c0cf0d-56bd-4241-95ac-edc5f4a655e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:09:59.801174 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 528/1041] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 17:09:59 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:09:59.958887 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7240be-1213-4d37-9be6-e84cbf07da5d None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:09:59.973326 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7240be-1213-4d37-9be6-e84cbf07da5d None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:09:59.978855 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d679a10-b9b9-4ed5-9e39-141189e8c242 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc2b7d015c2046ddacac6e682f22d0f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd57eaa6dbca24cbb99dce1fe3437ecae', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:09:59.979479 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d679a10-b9b9-4ed5-9e39-141189e8c242 service nova] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:09:59.979799 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d679a10-b9b9-4ed5-9e39-141189e8c242 service nova] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:09:59.980077 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d679a10-b9b9-4ed5-9e39-141189e8c242 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:09:59.988291 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d679a10-b9b9-4ed5-9e39-141189e8c242 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:09:59.989913 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d679a10-b9b9-4ed5-9e39-141189e8c242 service nova] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:09:59.999778 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 514/1042] 10.222.0.136 () {60 vars in 1370 bytes} [Thu Jul 14 17:09:59 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:10:00.879253 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12bcb61-60c3-4da9-bafe-0d9e46638e6f None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:10:00.879807 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12bcb61-60c3-4da9-bafe-0d9e46638e6f None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:10:00.879807 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12bcb61-60c3-4da9-bafe-0d9e46638e6f None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:10:00.881181 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 529/1043] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 17:10:00 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:10:00.886747 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd6ea91-e2e6-4ef3-a199-a3d63eb7b46a None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:10:00.887162 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd6ea91-e2e6-4ef3-a199-a3d63eb7b46a None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:10:00.887307 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd6ea91-e2e6-4ef3-a199-a3d63eb7b46a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:10:00.904960 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-7fd6ea91-e2e6-4ef3-a199-a3d63eb7b46a None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:10:00.906233 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-7fd6ea91-e2e6-4ef3-a199-a3d63eb7b46a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:10:00.914491 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 515/1044] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 17:10:00 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:10:01.072219 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12bcb61-60c3-4da9-bafe-0d9e46638e6f None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:10:01.085606 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12bcb61-60c3-4da9-bafe-0d9e46638e6f None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:10:01.091080 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649b6291-47dc-41df-847b-f1b7914aa27f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc2b7d015c2046ddacac6e682f22d0f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd57eaa6dbca24cbb99dce1fe3437ecae', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:10:01.091712 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649b6291-47dc-41df-847b-f1b7914aa27f service nova] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:10:01.091997 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649b6291-47dc-41df-847b-f1b7914aa27f service nova] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:10:01.092273 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649b6291-47dc-41df-847b-f1b7914aa27f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:10:01.100900 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649b6291-47dc-41df-847b-f1b7914aa27f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:10:01.102823 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649b6291-47dc-41df-847b-f1b7914aa27f service nova] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:10:01.112089 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 530/1045] 10.222.0.136 () {60 vars in 1370 bytes} [Thu Jul 14 17:10:01 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:10:01.932425 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cfc965-b27c-4221-ad74-1e87e75bf221 None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:10:01.933000 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cfc965-b27c-4221-ad74-1e87e75bf221 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:10:01.933000 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cfc965-b27c-4221-ad74-1e87e75bf221 None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:10:01.934431 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 516/1046] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 17:10:01 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 14 17:10:01.939253 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18b2662-de7e-429a-b7f5-71ac9e4ecd2c None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:10:01.939651 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18b2662-de7e-429a-b7f5-71ac9e4ecd2c None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:10:01.939822 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18b2662-de7e-429a-b7f5-71ac9e4ecd2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:10:01.957842 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-d18b2662-de7e-429a-b7f5-71ac9e4ecd2c None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:10:01.959114 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-d18b2662-de7e-429a-b7f5-71ac9e4ecd2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:10:01.967966 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 531/1047] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 17:10:01 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:10:02.124895 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cfc965-b27c-4221-ad74-1e87e75bf221 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:10:02.143121 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cfc965-b27c-4221-ad74-1e87e75bf221 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:10:02.148073 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b4bf6f-e9fb-44c7-817b-37f39bf98850 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc2b7d015c2046ddacac6e682f22d0f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd57eaa6dbca24cbb99dce1fe3437ecae', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:10:02.148728 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b4bf6f-e9fb-44c7-817b-37f39bf98850 service nova] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:10:02.149689 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b4bf6f-e9fb-44c7-817b-37f39bf98850 service nova] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:10:02.150199 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b4bf6f-e9fb-44c7-817b-37f39bf98850 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:10:02.158891 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b4bf6f-e9fb-44c7-817b-37f39bf98850 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:10:02.160487 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b4bf6f-e9fb-44c7-817b-37f39bf98850 service nova] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:10:02.170957 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 517/1048] 10.222.0.136 () {60 vars in 1370 bytes} [Thu Jul 14 17:10:02 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:10:02.999168 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fa5c12-dcd7-4259-9712-30ce34a69624 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:10:02.999703 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fa5c12-dcd7-4259-9712-30ce34a69624 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:10:02.999703 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fa5c12-dcd7-4259-9712-30ce34a69624 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:10:03.001068 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 532/1049] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 17:10:02 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:10:03.006235 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f1c188-ea61-4376-b975-ebedcb666c95 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:10:03.006651 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f1c188-ea61-4376-b975-ebedcb666c95 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:10:03.006804 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f1c188-ea61-4376-b975-ebedcb666c95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:10:03.024404 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-67f1c188-ea61-4376-b975-ebedcb666c95 None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:10:03.025717 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-67f1c188-ea61-4376-b975-ebedcb666c95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:10:03.033407 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 518/1050] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 17:10:03 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:10:03.200328 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fa5c12-dcd7-4259-9712-30ce34a69624 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:10:03.215043 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fa5c12-dcd7-4259-9712-30ce34a69624 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:10:03.219949 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc63a36-cc76-495e-badd-91bad310a14e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc2b7d015c2046ddacac6e682f22d0f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd57eaa6dbca24cbb99dce1fe3437ecae', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:10:03.220589 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc63a36-cc76-495e-badd-91bad310a14e service nova] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:10:03.220886 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc63a36-cc76-495e-badd-91bad310a14e service nova] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:10:03.221169 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc63a36-cc76-495e-badd-91bad310a14e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:10:03.230940 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc63a36-cc76-495e-badd-91bad310a14e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:10:03.232535 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc63a36-cc76-495e-badd-91bad310a14e service nova] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:10:03.242070 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 533/1051] 10.222.0.136 () {60 vars in 1370 bytes} [Thu Jul 14 17:10:03 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:10:04.059256 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573206d1-352d-40fd-9f59-bb92a7457915 None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:10:04.059800 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573206d1-352d-40fd-9f59-bb92a7457915 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:10:04.059800 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573206d1-352d-40fd-9f59-bb92a7457915 None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:10:04.061174 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 519/1052] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 17:10:04 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:10:04.066030 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaef5f41-dcb2-482c-979c-338afb1f3337 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:10:04.066462 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaef5f41-dcb2-482c-979c-338afb1f3337 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:10:04.066600 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaef5f41-dcb2-482c-979c-338afb1f3337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:10:04.084551 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-eaef5f41-dcb2-482c-979c-338afb1f3337 None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:10:04.086354 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-eaef5f41-dcb2-482c-979c-338afb1f3337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:10:04.094772 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 534/1053] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 17:10:04 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:10:04.255705 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573206d1-352d-40fd-9f59-bb92a7457915 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:10:04.269899 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573206d1-352d-40fd-9f59-bb92a7457915 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:10:04.275480 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45c8b6d-69fe-45d9-9e3e-95b132678e6a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc2b7d015c2046ddacac6e682f22d0f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd57eaa6dbca24cbb99dce1fe3437ecae', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:10:04.276139 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45c8b6d-69fe-45d9-9e3e-95b132678e6a service nova] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:10:04.276428 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45c8b6d-69fe-45d9-9e3e-95b132678e6a service nova] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:10:04.276710 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45c8b6d-69fe-45d9-9e3e-95b132678e6a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:10:04.284668 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45c8b6d-69fe-45d9-9e3e-95b132678e6a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:10:04.286281 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45c8b6d-69fe-45d9-9e3e-95b132678e6a service nova] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:10:04.295875 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 520/1054] 10.222.0.136 () {60 vars in 1370 bytes} [Thu Jul 14 17:10:04 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:10:05.151813 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b957713e-14c8-486c-9bbd-9db10e367c63 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:10:05.152488 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b957713e-14c8-486c-9bbd-9db10e367c63 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:10:05.152488 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b957713e-14c8-486c-9bbd-9db10e367c63 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:10:05.153830 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 535/1055] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 17:10:05 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:10:05.158716 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9169d03b-cab9-494a-85db-89faa2526b70 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:10:05.159127 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9169d03b-cab9-494a-85db-89faa2526b70 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:10:05.159281 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9169d03b-cab9-494a-85db-89faa2526b70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:10:05.177661 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-9169d03b-cab9-494a-85db-89faa2526b70 None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:10:05.178839 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-9169d03b-cab9-494a-85db-89faa2526b70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:10:05.187339 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 521/1056] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 17:10:05 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:10:05.343306 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b957713e-14c8-486c-9bbd-9db10e367c63 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:10:05.357493 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b957713e-14c8-486c-9bbd-9db10e367c63 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:10:05.362552 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684cc8b1-35d2-47e7-9e6e-74916c09d7d6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc2b7d015c2046ddacac6e682f22d0f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd57eaa6dbca24cbb99dce1fe3437ecae', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:10:05.363185 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684cc8b1-35d2-47e7-9e6e-74916c09d7d6 service nova] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:10:05.363475 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684cc8b1-35d2-47e7-9e6e-74916c09d7d6 service nova] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:10:05.363757 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684cc8b1-35d2-47e7-9e6e-74916c09d7d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:10:05.372539 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684cc8b1-35d2-47e7-9e6e-74916c09d7d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:10:05.374178 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684cc8b1-35d2-47e7-9e6e-74916c09d7d6 service nova] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:10:05.383684 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 536/1057] 10.222.0.136 () {60 vars in 1370 bytes} [Thu Jul 14 17:10:05 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:10:07.550374 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4978e2e8-db77-4fe2-abba-f63c7be067a4 None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:10:07.550919 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4978e2e8-db77-4fe2-abba-f63c7be067a4 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:10:07.550919 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4978e2e8-db77-4fe2-abba-f63c7be067a4 None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:10:07.552292 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 522/1058] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 17:10:07 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 14 17:10:07.557684 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a336ebf-cd0c-479b-96e5-ad596042b144 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:10:07.558137 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a336ebf-cd0c-479b-96e5-ad596042b144 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:10:07.558243 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a336ebf-cd0c-479b-96e5-ad596042b144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:10:07.577042 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-0a336ebf-cd0c-479b-96e5-ad596042b144 None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:10:07.578271 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-0a336ebf-cd0c-479b-96e5-ad596042b144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:10:07.585995 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 537/1059] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 17:10:07 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 17:10:07.626747 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4978e2e8-db77-4fe2-abba-f63c7be067a4 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:10:07.638175 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4978e2e8-db77-4fe2-abba-f63c7be067a4 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:10:07.641671 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11971ff-16ee-4fa1-8d49-c0c706c977c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8c6871e11f047e284afdb16bcb1d3a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd57eaa6dbca24cbb99dce1fe3437ecae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:10:07.642333 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11971ff-16ee-4fa1-8d49-c0c706c977c4 service neutron] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:10:07.642620 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11971ff-16ee-4fa1-8d49-c0c706c977c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:10:07.642902 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11971ff-16ee-4fa1-8d49-c0c706c977c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:10:07.652448 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11971ff-16ee-4fa1-8d49-c0c706c977c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:10:07.653982 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11971ff-16ee-4fa1-8d49-c0c706c977c4 service neutron] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:10:07.663238 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 523/1060] 10.222.0.136 () {60 vars in 1370 bytes} [Thu Jul 14 17:10:07 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:10:10.130980 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0cf3e2-f884-44b5-8de5-c19c0be35977 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:10:10.131713 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0cf3e2-f884-44b5-8de5-c19c0be35977 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:10:10.131713 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0cf3e2-f884-44b5-8de5-c19c0be35977 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:10:10.134116 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 538/1061] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 17:10:10 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:10:10.140870 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c864727c-e471-47ff-bbee-c964c7015eca None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:10:10.141390 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c864727c-e471-47ff-bbee-c964c7015eca None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:10:10.141514 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c864727c-e471-47ff-bbee-c964c7015eca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:10:10.162594 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-c864727c-e471-47ff-bbee-c964c7015eca None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:10:10.163983 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-c864727c-e471-47ff-bbee-c964c7015eca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:10:10.174149 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 524/1062] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 17:10:10 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:10:10.246934 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0cf3e2-f884-44b5-8de5-c19c0be35977 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:10:10.275012 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0cf3e2-f884-44b5-8de5-c19c0be35977 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:10:10.284897 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778770af-1596-4324-98eb-ec97f6a3d28b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8c6871e11f047e284afdb16bcb1d3a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd57eaa6dbca24cbb99dce1fe3437ecae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:10:10.285602 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778770af-1596-4324-98eb-ec97f6a3d28b service neutron] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:10:10.285883 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778770af-1596-4324-98eb-ec97f6a3d28b service neutron] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:10:10.286339 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778770af-1596-4324-98eb-ec97f6a3d28b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:10:10.308295 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778770af-1596-4324-98eb-ec97f6a3d28b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:10:10.310142 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778770af-1596-4324-98eb-ec97f6a3d28b service neutron] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:10:10.321994 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 539/1063] 10.222.0.136 () {60 vars in 1370 bytes} [Thu Jul 14 17:10:10 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:10:13.033852 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e82a01-5e2f-4720-b83a-5d0cd09d602e None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:10:13.034419 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e82a01-5e2f-4720-b83a-5d0cd09d602e None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:10:13.034419 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e82a01-5e2f-4720-b83a-5d0cd09d602e None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:10:13.035785 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 525/1064] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 17:10:13 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:10:13.041954 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4a571f-dc8d-4f27-8f52-611267260798 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:10:13.042401 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4a571f-dc8d-4f27-8f52-611267260798 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:10:13.042510 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4a571f-dc8d-4f27-8f52-611267260798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:10:13.060322 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-cd4a571f-dc8d-4f27-8f52-611267260798 None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:10:13.061449 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-cd4a571f-dc8d-4f27-8f52-611267260798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:10:13.069268 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 540/1065] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 17:10:13 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:10:13.109216 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e82a01-5e2f-4720-b83a-5d0cd09d602e None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:10:13.119739 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e82a01-5e2f-4720-b83a-5d0cd09d602e None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:10:13.123408 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11700e5b-3587-4a71-95fe-c9ceefdaafb0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8c6871e11f047e284afdb16bcb1d3a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd57eaa6dbca24cbb99dce1fe3437ecae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:10:13.124057 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11700e5b-3587-4a71-95fe-c9ceefdaafb0 service neutron] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:10:13.124346 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11700e5b-3587-4a71-95fe-c9ceefdaafb0 service neutron] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:10:13.124625 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11700e5b-3587-4a71-95fe-c9ceefdaafb0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:10:13.134980 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11700e5b-3587-4a71-95fe-c9ceefdaafb0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:10:13.136428 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11700e5b-3587-4a71-95fe-c9ceefdaafb0 service neutron] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:10:13.146212 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 526/1066] 10.222.0.136 () {60 vars in 1370 bytes} [Thu Jul 14 17:10:13 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 17:10:15.492945 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6cb93d-2155-4f98-9d10-e2cbd9a349d8 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:10:15.493454 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6cb93d-2155-4f98-9d10-e2cbd9a349d8 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:10:15.493763 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6cb93d-2155-4f98-9d10-e2cbd9a349d8 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:10:15.495145 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 541/1067] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 17:10:15 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:10:15.500361 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2577e277-9c1f-4baa-9c82-5436700d285c None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:10:15.500813 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2577e277-9c1f-4baa-9c82-5436700d285c None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:10:15.500925 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2577e277-9c1f-4baa-9c82-5436700d285c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:10:15.519163 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-2577e277-9c1f-4baa-9c82-5436700d285c None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:10:15.520341 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-2577e277-9c1f-4baa-9c82-5436700d285c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:10:15.528095 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 527/1068] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 17:10:15 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:10:15.567485 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6cb93d-2155-4f98-9d10-e2cbd9a349d8 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:10:15.578718 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6cb93d-2155-4f98-9d10-e2cbd9a349d8 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:10:15.582201 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518942e6-ef0b-49df-ac88-1c0f2746e5a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8c6871e11f047e284afdb16bcb1d3a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd57eaa6dbca24cbb99dce1fe3437ecae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:10:15.582833 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518942e6-ef0b-49df-ac88-1c0f2746e5a9 service neutron] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:10:15.583117 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518942e6-ef0b-49df-ac88-1c0f2746e5a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:10:15.583396 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518942e6-ef0b-49df-ac88-1c0f2746e5a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:10:15.592251 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518942e6-ef0b-49df-ac88-1c0f2746e5a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:10:15.593687 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518942e6-ef0b-49df-ac88-1c0f2746e5a9 service neutron] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:10:15.604352 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 542/1069] 10.222.0.136 () {60 vars in 1370 bytes} [Thu Jul 14 17:10:15 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:10:17.987517 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3da48e1-765c-4f15-b35e-29486f1ddd8e None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:10:17.988115 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3da48e1-765c-4f15-b35e-29486f1ddd8e None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:10:17.988115 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3da48e1-765c-4f15-b35e-29486f1ddd8e None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:10:17.989441 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 528/1070] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 17:10:17 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:10:17.995670 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9316d9c5-11cf-46b4-82e2-c0bc91fa6c1c None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:10:17.996123 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9316d9c5-11cf-46b4-82e2-c0bc91fa6c1c None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:10:17.996231 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9316d9c5-11cf-46b4-82e2-c0bc91fa6c1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:10:18.013891 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-9316d9c5-11cf-46b4-82e2-c0bc91fa6c1c None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:10:18.015105 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-9316d9c5-11cf-46b4-82e2-c0bc91fa6c1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:10:18.022816 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 543/1071] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 17:10:17 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:10:18.063246 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3da48e1-765c-4f15-b35e-29486f1ddd8e None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:10:18.073931 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3da48e1-765c-4f15-b35e-29486f1ddd8e None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:10:18.077352 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5206109-a830-436d-b140-6b614854143f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8c6871e11f047e284afdb16bcb1d3a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd57eaa6dbca24cbb99dce1fe3437ecae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:10:18.078009 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5206109-a830-436d-b140-6b614854143f service neutron] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:10:18.078297 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5206109-a830-436d-b140-6b614854143f service neutron] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:10:18.078575 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5206109-a830-436d-b140-6b614854143f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:10:18.087554 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5206109-a830-436d-b140-6b614854143f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:10:18.088991 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5206109-a830-436d-b140-6b614854143f service neutron] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:10:18.098657 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 529/1072] 10.222.0.136 () {60 vars in 1370 bytes} [Thu Jul 14 17:10:18 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:10:20.406758 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8db9ee9-888e-4cd3-8694-8b1a212bf2b8 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:10:20.407442 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8db9ee9-888e-4cd3-8694-8b1a212bf2b8 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:10:20.407442 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8db9ee9-888e-4cd3-8694-8b1a212bf2b8 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:10:20.408722 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 544/1073] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 17:10:20 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:10:20.414479 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f97ff9b-e693-49b0-ad9e-73c3754fd05b None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:10:20.415316 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f97ff9b-e693-49b0-ad9e-73c3754fd05b None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:10:20.415609 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f97ff9b-e693-49b0-ad9e-73c3754fd05b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:10:20.421694 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=70 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:10:20.434760 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-1f97ff9b-e693-49b0-ad9e-73c3754fd05b None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:10:20.435961 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-1f97ff9b-e693-49b0-ad9e-73c3754fd05b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:10:20.443726 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 530/1074] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 17:10:20 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:10:20.483926 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8db9ee9-888e-4cd3-8694-8b1a212bf2b8 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:10:20.489252 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=64 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:10:20.496265 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8db9ee9-888e-4cd3-8694-8b1a212bf2b8 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:10:20.499719 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935aea44-fe4d-4003-bec6-e89d94e9373c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8c6871e11f047e284afdb16bcb1d3a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd57eaa6dbca24cbb99dce1fe3437ecae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:10:20.500480 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935aea44-fe4d-4003-bec6-e89d94e9373c service neutron] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:10:20.500770 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935aea44-fe4d-4003-bec6-e89d94e9373c service neutron] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:10:20.501053 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935aea44-fe4d-4003-bec6-e89d94e9373c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:10:20.510751 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935aea44-fe4d-4003-bec6-e89d94e9373c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:10:20.512187 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935aea44-fe4d-4003-bec6-e89d94e9373c service neutron] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:10:20.521802 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 545/1075] 10.222.0.136 () {60 vars in 1370 bytes} [Thu Jul 14 17:10:20 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:10:22.908530 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec013ef-5ed3-4458-92a3-101e2b73387a None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:10:22.909090 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec013ef-5ed3-4458-92a3-101e2b73387a None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:10:22.909090 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec013ef-5ed3-4458-92a3-101e2b73387a None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:10:22.910653 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 531/1076] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 17:10:22 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:10:22.915970 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9028673b-3697-490f-8d17-daded120b94c None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:10:22.916382 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9028673b-3697-490f-8d17-daded120b94c None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:10:22.916514 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9028673b-3697-490f-8d17-daded120b94c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:10:22.934352 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-9028673b-3697-490f-8d17-daded120b94c None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:10:22.935540 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-9028673b-3697-490f-8d17-daded120b94c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:10:22.943283 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 546/1077] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 17:10:22 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 17:10:22.982527 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec013ef-5ed3-4458-92a3-101e2b73387a None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:10:22.993861 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec013ef-5ed3-4458-92a3-101e2b73387a None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:10:22.997275 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfeadfb-a51a-4cc3-b1d1-59a5eb650994 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8c6871e11f047e284afdb16bcb1d3a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd57eaa6dbca24cbb99dce1fe3437ecae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:10:22.997953 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfeadfb-a51a-4cc3-b1d1-59a5eb650994 service neutron] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:10:22.998242 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfeadfb-a51a-4cc3-b1d1-59a5eb650994 service neutron] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:10:22.998527 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfeadfb-a51a-4cc3-b1d1-59a5eb650994 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:10:23.007426 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfeadfb-a51a-4cc3-b1d1-59a5eb650994 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:10:23.009424 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfeadfb-a51a-4cc3-b1d1-59a5eb650994 service neutron] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:10:23.019125 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 532/1078] 10.222.0.136 () {60 vars in 1370 bytes} [Thu Jul 14 17:10:22 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:10:25.346608 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6178f73f-130b-496d-9c50-67c340845db6 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:10:25.347484 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6178f73f-130b-496d-9c50-67c340845db6 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:10:25.347484 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6178f73f-130b-496d-9c50-67c340845db6 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:10:25.348879 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 547/1079] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 17:10:25 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:10:25.354748 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37761e82-e1c9-43cb-a601-a4ca78fb5b48 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:10:25.355164 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37761e82-e1c9-43cb-a601-a4ca78fb5b48 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:10:25.355316 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37761e82-e1c9-43cb-a601-a4ca78fb5b48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:10:25.373264 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-37761e82-e1c9-43cb-a601-a4ca78fb5b48 None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:10:25.374467 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-37761e82-e1c9-43cb-a601-a4ca78fb5b48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:10:25.382061 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 533/1080] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 17:10:25 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:10:25.420964 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6178f73f-130b-496d-9c50-67c340845db6 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:10:25.432398 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6178f73f-130b-496d-9c50-67c340845db6 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:10:25.435889 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a006eb-2626-4f50-b4b0-d00b7dfef3fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8c6871e11f047e284afdb16bcb1d3a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd57eaa6dbca24cbb99dce1fe3437ecae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:10:25.436521 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a006eb-2626-4f50-b4b0-d00b7dfef3fc service neutron] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:10:25.436806 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a006eb-2626-4f50-b4b0-d00b7dfef3fc service neutron] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:10:25.437084 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a006eb-2626-4f50-b4b0-d00b7dfef3fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:10:25.446826 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a006eb-2626-4f50-b4b0-d00b7dfef3fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:10:25.448247 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a006eb-2626-4f50-b4b0-d00b7dfef3fc service neutron] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:10:25.457471 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 548/1081] 10.222.0.136 () {60 vars in 1370 bytes} [Thu Jul 14 17:10:25 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:10:27.771345 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27e1866-27f6-448c-8c60-248d0dc09d9f None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:10:27.771881 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27e1866-27f6-448c-8c60-248d0dc09d9f None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:10:27.771998 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27e1866-27f6-448c-8c60-248d0dc09d9f None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:10:27.774142 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 534/1082] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 17:10:27 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:10:27.779232 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d72b688-018f-4873-919a-0bb4fe694781 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:10:27.779665 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d72b688-018f-4873-919a-0bb4fe694781 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:10:27.779777 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d72b688-018f-4873-919a-0bb4fe694781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:10:27.797679 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-5d72b688-018f-4873-919a-0bb4fe694781 None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:10:27.798855 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-5d72b688-018f-4873-919a-0bb4fe694781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:10:27.806645 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 549/1083] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 17:10:27 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 17:10:27.844465 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27e1866-27f6-448c-8c60-248d0dc09d9f None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:10:27.855939 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27e1866-27f6-448c-8c60-248d0dc09d9f None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:10:27.859436 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9a6c80-460f-44a9-b75b-83842a57a70b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8c6871e11f047e284afdb16bcb1d3a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd57eaa6dbca24cbb99dce1fe3437ecae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:10:27.860073 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9a6c80-460f-44a9-b75b-83842a57a70b service neutron] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:10:27.860362 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9a6c80-460f-44a9-b75b-83842a57a70b service neutron] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:10:27.860645 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9a6c80-460f-44a9-b75b-83842a57a70b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:10:27.869459 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9a6c80-460f-44a9-b75b-83842a57a70b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:10:27.870926 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9a6c80-460f-44a9-b75b-83842a57a70b service neutron] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:10:27.880523 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 535/1084] 10.222.0.136 () {60 vars in 1370 bytes} [Thu Jul 14 17:10:27 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:10:30.158330 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f9f29f-f78c-42b3-935c-8ee19fefe5d1 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:10:30.158873 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f9f29f-f78c-42b3-935c-8ee19fefe5d1 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:10:30.158873 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f9f29f-f78c-42b3-935c-8ee19fefe5d1 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:10:30.160235 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 550/1085] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 17:10:30 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 14 17:10:30.166449 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe577c5a-4cd4-4218-9e27-0e8ce0c8c5ae None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:10:30.166864 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe577c5a-4cd4-4218-9e27-0e8ce0c8c5ae None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:10:30.167014 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe577c5a-4cd4-4218-9e27-0e8ce0c8c5ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:10:30.184723 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-fe577c5a-4cd4-4218-9e27-0e8ce0c8c5ae None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:10:30.185955 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-fe577c5a-4cd4-4218-9e27-0e8ce0c8c5ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:10:30.194428 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 536/1086] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 17:10:30 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 17:10:30.232852 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f9f29f-f78c-42b3-935c-8ee19fefe5d1 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:10:30.243586 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f9f29f-f78c-42b3-935c-8ee19fefe5d1 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:10:30.247068 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed1b828-c734-4863-8566-7abbdaa6ebb5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8c6871e11f047e284afdb16bcb1d3a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd57eaa6dbca24cbb99dce1fe3437ecae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:10:30.247701 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed1b828-c734-4863-8566-7abbdaa6ebb5 service neutron] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:10:30.247985 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed1b828-c734-4863-8566-7abbdaa6ebb5 service neutron] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:10:30.248261 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed1b828-c734-4863-8566-7abbdaa6ebb5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:10:30.257003 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed1b828-c734-4863-8566-7abbdaa6ebb5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:10:30.259235 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed1b828-c734-4863-8566-7abbdaa6ebb5 service neutron] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:10:30.274251 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 551/1087] 10.222.0.136 () {60 vars in 1370 bytes} [Thu Jul 14 17:10:30 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:10:40.179522 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=20 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:10:40.268909 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=23 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:10:54.383707 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bce2b57-e531-4fa8-bedb-620cda1c4bc8 None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:10:54.384318 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bce2b57-e531-4fa8-bedb-620cda1c4bc8 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:10:54.384318 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bce2b57-e531-4fa8-bedb-620cda1c4bc8 None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:10:54.385665 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 537/1088] 10.222.0.136 () {54 vars in 931 bytes} [Thu Jul 14 17:10:54 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:10:54.390996 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7aaed3-0125-4df0-85e8-5885e9bf7ed3 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:10:54.391470 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7aaed3-0125-4df0-85e8-5885e9bf7ed3 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:10:54.391598 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7aaed3-0125-4df0-85e8-5885e9bf7ed3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:10:54.409015 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-bf7aaed3-0125-4df0-85e8-5885e9bf7ed3 None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:10:54.410272 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-bf7aaed3-0125-4df0-85e8-5885e9bf7ed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:10:54.418690 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 552/1089] 10.222.0.136 () {58 vars in 1028 bytes} [Thu Jul 14 17:10:54 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:10:54.470461 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ff6db5-b252-4881-84f6-b7034cf41cec None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:10:54.470755 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ff6db5-b252-4881-84f6-b7034cf41cec None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:10:54.471034 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ff6db5-b252-4881-84f6-b7034cf41cec None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:10:54.472648 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 538/1090] 10.222.0.136 () {54 vars in 967 bytes} [Thu Jul 14 17:10:54 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:10:54.479552 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fbb61b-9b5a-46cf-bf23-7b54648a1695 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:10:54.479844 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fbb61b-9b5a-46cf-bf23-7b54648a1695 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:10:54.480126 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fbb61b-9b5a-46cf-bf23-7b54648a1695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:10:54.498661 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-c5fbb61b-9b5a-46cf-bf23-7b54648a1695 None None] MFA Rules not processed for user `c2c3d46d376c460a99426a5dc7c66115`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:10:54.499851 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-c5fbb61b-9b5a-46cf-bf23-7b54648a1695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:10:54.506705 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 553/1091] 10.222.0.136 () {58 vars in 1064 bytes} [Thu Jul 14 17:10:54 2022] POST /identity/v3/auth/tokens => generated 2678 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 17:10:54.514155 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ff6db5-b252-4881-84f6-b7034cf41cec None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:10:54.525427 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ff6db5-b252-4881-84f6-b7034cf41cec None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:10:54.528942 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e888817a-9c6c-48b1-bc78-5f091f96ae5e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c3d46d376c460a99426a5dc7c66115', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd57eaa6dbca24cbb99dce1fe3437ecae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:10:54.529673 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e888817a-9c6c-48b1-bc78-5f091f96ae5e service glance] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:10:54.529963 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e888817a-9c6c-48b1-bc78-5f091f96ae5e service glance] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:10:54.530246 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e888817a-9c6c-48b1-bc78-5f091f96ae5e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:10:54.539910 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e888817a-9c6c-48b1-bc78-5f091f96ae5e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:10:54.541613 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e888817a-9c6c-48b1-bc78-5f091f96ae5e service glance] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:10:54.551142 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 539/1092] 10.222.0.136 () {60 vars in 1370 bytes} [Thu Jul 14 17:10:54 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:10:56.934047 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ecacba-b4a5-497f-b4fa-808db3962f37 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:10:56.934610 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ecacba-b4a5-497f-b4fa-808db3962f37 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:10:56.934610 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ecacba-b4a5-497f-b4fa-808db3962f37 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:10:56.935960 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 554/1093] 10.222.0.136 () {54 vars in 931 bytes} [Thu Jul 14 17:10:56 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:10:56.941069 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6905912-4b76-48cc-bef5-eac3d1f08e8d None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:10:56.941528 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6905912-4b76-48cc-bef5-eac3d1f08e8d None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:10:56.941669 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6905912-4b76-48cc-bef5-eac3d1f08e8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:10:56.961651 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-a6905912-4b76-48cc-bef5-eac3d1f08e8d None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:10:56.962931 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-a6905912-4b76-48cc-bef5-eac3d1f08e8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:10:56.970912 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 540/1094] 10.222.0.136 () {58 vars in 1028 bytes} [Thu Jul 14 17:10:56 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:10:56.995671 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ecacba-b4a5-497f-b4fa-808db3962f37 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:10:57.008986 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ecacba-b4a5-497f-b4fa-808db3962f37 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:10:57.013380 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af81d8af-2f56-4952-8f16-e56261a41565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '602fa21468b24207a8f98e92cd2c99ce', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:10:57.014087 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af81d8af-2f56-4952-8f16-e56261a41565 admin admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:10:57.014373 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af81d8af-2f56-4952-8f16-e56261a41565 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:10:57.014653 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af81d8af-2f56-4952-8f16-e56261a41565 admin admin] PATH_INFO: `/v3/projects` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:10:57.015384 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af81d8af-2f56-4952-8f16-e56261a41565 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:10:57.017192 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: WARNING py.warnings [None req-af81d8af-2f56-4952-8f16-e56261a41565 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 17:10:57.017192 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: warnings.warn(msg) Jul 14 17:10:57.017192 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: Jul 14 17:10:57.018380 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af81d8af-2f56-4952-8f16-e56261a41565 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:10:57.036590 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 555/1095] 10.222.0.136 () {56 vars in 1113 bytes} [Thu Jul 14 17:10:56 2022] GET /identity/v3/projects => generated 1612 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 17:10:59.311503 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cb8284-f5fe-4b31-865d-c7fd26316153 None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:10:59.312089 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cb8284-f5fe-4b31-865d-c7fd26316153 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:10:59.312089 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cb8284-f5fe-4b31-865d-c7fd26316153 None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:10:59.313598 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 541/1096] 10.222.0.136 () {54 vars in 931 bytes} [Thu Jul 14 17:10:59 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:10:59.318900 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987f69f9-6914-4b6d-bf13-f4b99cc3e6d4 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:10:59.319332 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987f69f9-6914-4b6d-bf13-f4b99cc3e6d4 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:10:59.319504 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987f69f9-6914-4b6d-bf13-f4b99cc3e6d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:10:59.338133 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-987f69f9-6914-4b6d-bf13-f4b99cc3e6d4 None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:10:59.339317 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-987f69f9-6914-4b6d-bf13-f4b99cc3e6d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:10:59.347465 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 556/1097] 10.222.0.136 () {58 vars in 1028 bytes} [Thu Jul 14 17:10:59 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:10:59.391687 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cb8284-f5fe-4b31-865d-c7fd26316153 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:10:59.405993 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cb8284-f5fe-4b31-865d-c7fd26316153 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:10:59.410802 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8361a069-a717-416f-bced-b62a439c3b54 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc2b7d015c2046ddacac6e682f22d0f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd57eaa6dbca24cbb99dce1fe3437ecae', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:10:59.411439 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8361a069-a717-416f-bced-b62a439c3b54 service nova] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:10:59.411727 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8361a069-a717-416f-bced-b62a439c3b54 service nova] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:10:59.412008 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8361a069-a717-416f-bced-b62a439c3b54 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:10:59.420762 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8361a069-a717-416f-bced-b62a439c3b54 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:10:59.422374 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8361a069-a717-416f-bced-b62a439c3b54 service nova] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:10:59.431790 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 542/1098] 10.222.0.136 () {60 vars in 1370 bytes} [Thu Jul 14 17:10:59 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:11:01.841224 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89adcb35-b55c-46d7-a163-f4ac9536116b None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:11:01.841830 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89adcb35-b55c-46d7-a163-f4ac9536116b None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:11:01.841830 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89adcb35-b55c-46d7-a163-f4ac9536116b None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:11:01.843158 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 557/1099] 10.222.0.136 () {54 vars in 931 bytes} [Thu Jul 14 17:11:01 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:11:01.848545 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ca657c-e84a-40dd-ac89-6a6a9eefe240 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:11:01.848955 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ca657c-e84a-40dd-ac89-6a6a9eefe240 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:11:01.849189 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ca657c-e84a-40dd-ac89-6a6a9eefe240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:11:01.867899 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-80ca657c-e84a-40dd-ac89-6a6a9eefe240 None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:11:01.869101 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-80ca657c-e84a-40dd-ac89-6a6a9eefe240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:11:01.876982 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 543/1100] 10.222.0.136 () {58 vars in 1028 bytes} [Thu Jul 14 17:11:01 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:11:01.914075 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89adcb35-b55c-46d7-a163-f4ac9536116b None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:11:01.925625 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89adcb35-b55c-46d7-a163-f4ac9536116b None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:11:01.929697 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3225560c-4182-4fbf-a39f-4be4673c2035 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8c6871e11f047e284afdb16bcb1d3a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd57eaa6dbca24cbb99dce1fe3437ecae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:11:01.930340 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3225560c-4182-4fbf-a39f-4be4673c2035 service neutron] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:11:01.930623 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3225560c-4182-4fbf-a39f-4be4673c2035 service neutron] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:11:01.930895 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3225560c-4182-4fbf-a39f-4be4673c2035 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:11:01.939676 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3225560c-4182-4fbf-a39f-4be4673c2035 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:11:01.941105 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3225560c-4182-4fbf-a39f-4be4673c2035 service neutron] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:11:01.950698 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 558/1101] 10.222.0.136 () {60 vars in 1370 bytes} [Thu Jul 14 17:11:01 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:11:04.289067 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343193f7-527e-4cad-a3c3-526925f74c05 None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:11:04.289708 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343193f7-527e-4cad-a3c3-526925f74c05 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:11:04.289708 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343193f7-527e-4cad-a3c3-526925f74c05 None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:11:04.291125 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 544/1102] 10.222.0.136 () {54 vars in 931 bytes} [Thu Jul 14 17:11:04 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:11:04.296314 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ab0e80-3707-4849-9129-af20c255b415 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:11:04.296720 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ab0e80-3707-4849-9129-af20c255b415 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:11:04.296872 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ab0e80-3707-4849-9129-af20c255b415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:11:04.315215 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-79ab0e80-3707-4849-9129-af20c255b415 None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:11:04.316399 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-79ab0e80-3707-4849-9129-af20c255b415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:11:04.324807 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 559/1103] 10.222.0.136 () {58 vars in 1028 bytes} [Thu Jul 14 17:11:04 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:11:04.363539 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343193f7-527e-4cad-a3c3-526925f74c05 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:11:04.375608 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343193f7-527e-4cad-a3c3-526925f74c05 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:11:04.379166 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4d80d1-ab29-4d49-a187-e3712292fd4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8c6871e11f047e284afdb16bcb1d3a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd57eaa6dbca24cbb99dce1fe3437ecae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:11:04.379852 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4d80d1-ab29-4d49-a187-e3712292fd4f service neutron] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:11:04.380146 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4d80d1-ab29-4d49-a187-e3712292fd4f service neutron] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:11:04.380430 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4d80d1-ab29-4d49-a187-e3712292fd4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:11:04.390664 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4d80d1-ab29-4d49-a187-e3712292fd4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:11:04.392095 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4d80d1-ab29-4d49-a187-e3712292fd4f service neutron] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:11:04.402372 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 545/1104] 10.222.0.136 () {60 vars in 1370 bytes} [Thu Jul 14 17:11:04 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:11:06.779705 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cccc58a-bbe9-40e7-a6c8-be5a2417010d None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:11:06.780358 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cccc58a-bbe9-40e7-a6c8-be5a2417010d None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:11:06.780358 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cccc58a-bbe9-40e7-a6c8-be5a2417010d None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:11:06.781804 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 560/1105] 10.222.0.136 () {54 vars in 931 bytes} [Thu Jul 14 17:11:06 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:11:06.786936 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d86ec9f-f75c-414d-8d03-ef6a4c23e391 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:11:06.787375 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d86ec9f-f75c-414d-8d03-ef6a4c23e391 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:11:06.787484 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d86ec9f-f75c-414d-8d03-ef6a4c23e391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:11:06.806401 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-5d86ec9f-f75c-414d-8d03-ef6a4c23e391 None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:11:06.807597 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-5d86ec9f-f75c-414d-8d03-ef6a4c23e391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:11:06.815299 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 546/1106] 10.222.0.136 () {58 vars in 1028 bytes} [Thu Jul 14 17:11:06 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:11:06.856117 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cccc58a-bbe9-40e7-a6c8-be5a2417010d None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:11:06.867270 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cccc58a-bbe9-40e7-a6c8-be5a2417010d None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:11:06.870716 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe157a6-a06f-4e02-a4f3-7481669a62a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8c6871e11f047e284afdb16bcb1d3a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd57eaa6dbca24cbb99dce1fe3437ecae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:11:06.871350 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe157a6-a06f-4e02-a4f3-7481669a62a6 service neutron] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:11:06.871636 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe157a6-a06f-4e02-a4f3-7481669a62a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:11:06.871916 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe157a6-a06f-4e02-a4f3-7481669a62a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:11:06.880799 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe157a6-a06f-4e02-a4f3-7481669a62a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:11:06.883163 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe157a6-a06f-4e02-a4f3-7481669a62a6 service neutron] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:11:06.892666 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 561/1107] 10.222.0.136 () {60 vars in 1370 bytes} [Thu Jul 14 17:11:06 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:11:09.437005 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec9fc27-8228-44b2-b321-fb13a8f13863 None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:11:09.437603 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec9fc27-8228-44b2-b321-fb13a8f13863 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:11:09.437603 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec9fc27-8228-44b2-b321-fb13a8f13863 None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:11:09.438977 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 547/1108] 10.222.0.136 () {54 vars in 931 bytes} [Thu Jul 14 17:11:09 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:11:09.444754 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a4e65e-9d2b-4dbd-a7cf-d68ddec725ec None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:11:09.445240 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a4e65e-9d2b-4dbd-a7cf-d68ddec725ec None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:11:09.445853 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a4e65e-9d2b-4dbd-a7cf-d68ddec725ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:11:09.464589 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-06a4e65e-9d2b-4dbd-a7cf-d68ddec725ec None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:11:09.465790 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-06a4e65e-9d2b-4dbd-a7cf-d68ddec725ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:11:09.473795 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 562/1109] 10.222.0.136 () {58 vars in 1028 bytes} [Thu Jul 14 17:11:09 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:11:09.514777 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec9fc27-8228-44b2-b321-fb13a8f13863 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:11:09.526127 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec9fc27-8228-44b2-b321-fb13a8f13863 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:11:09.529521 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8c2014-69b0-4f62-af8c-1662cb73e7d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8c6871e11f047e284afdb16bcb1d3a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd57eaa6dbca24cbb99dce1fe3437ecae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:11:09.530183 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8c2014-69b0-4f62-af8c-1662cb73e7d7 service neutron] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:11:09.530466 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8c2014-69b0-4f62-af8c-1662cb73e7d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:11:09.530742 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8c2014-69b0-4f62-af8c-1662cb73e7d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:11:09.539755 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8c2014-69b0-4f62-af8c-1662cb73e7d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:11:09.541173 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8c2014-69b0-4f62-af8c-1662cb73e7d7 service neutron] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:11:09.550356 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 548/1110] 10.222.0.136 () {60 vars in 1370 bytes} [Thu Jul 14 17:11:09 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:11:19.458318 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=33 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:11:19.546346 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=33 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:12:46.031818 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98deb318-ffd5-490e-8f4f-dea3fd222aed None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:12:46.032431 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98deb318-ffd5-490e-8f4f-dea3fd222aed None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:12:46.032534 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98deb318-ffd5-490e-8f4f-dea3fd222aed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:12:46.051318 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-98deb318-ffd5-490e-8f4f-dea3fd222aed None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:12:46.052532 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-98deb318-ffd5-490e-8f4f-dea3fd222aed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:12:46.061473 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 563/1111] 10.222.0.136 () {58 vars in 962 bytes} [Thu Jul 14 17:12:46 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:12:46.069604 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665494d1-25d9-4696-a1a9-522a449ab4ae None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:12:46.070245 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665494d1-25d9-4696-a1a9-522a449ab4ae None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:12:46.070532 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665494d1-25d9-4696-a1a9-522a449ab4ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:12:46.088370 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-665494d1-25d9-4696-a1a9-522a449ab4ae None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:12:46.089692 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-665494d1-25d9-4696-a1a9-522a449ab4ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:12:46.097681 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 549/1112] 10.222.0.136 () {58 vars in 962 bytes} [Thu Jul 14 17:12:46 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:12:46.103363 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98deb318-ffd5-490e-8f4f-dea3fd222aed None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:12:46.113000 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98deb318-ffd5-490e-8f4f-dea3fd222aed None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:12:46.118219 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d563f69d-a087-4b13-88f9-de821c549a31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '602fa21468b24207a8f98e92cd2c99ce', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:12:46.118875 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d563f69d-a087-4b13-88f9-de821c549a31 admin admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:12:46.119156 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d563f69d-a087-4b13-88f9-de821c549a31 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:12:46.119432 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d563f69d-a087-4b13-88f9-de821c549a31 admin admin] PATH_INFO: `/v3/domains` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:12:46.120183 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d563f69d-a087-4b13-88f9-de821c549a31 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:12:46.120491 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d563f69d-a087-4b13-88f9-de821c549a31 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:12:46.121500 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: WARNING py.warnings [None req-d563f69d-a087-4b13-88f9-de821c549a31 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 17:12:46.121500 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: warnings.warn(msg) Jul 14 17:12:46.121500 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: Jul 14 17:12:46.122412 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d563f69d-a087-4b13-88f9-de821c549a31 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:12:46.134581 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 564/1113] 10.222.0.136 () {58 vars in 1157 bytes} [Thu Jul 14 17:12:46 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 17:12:46.142596 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665494d1-25d9-4696-a1a9-522a449ab4ae None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:12:46.152645 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665494d1-25d9-4696-a1a9-522a449ab4ae None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:12:46.157260 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d2d5e5-d074-414a-aaeb-a4521d67a8a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '602fa21468b24207a8f98e92cd2c99ce', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:12:46.157951 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d2d5e5-d074-414a-aaeb-a4521d67a8a5 admin admin] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:12:46.158240 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d2d5e5-d074-414a-aaeb-a4521d67a8a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:12:46.158527 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d2d5e5-d074-414a-aaeb-a4521d67a8a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:12:46.159206 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d2d5e5-d074-414a-aaeb-a4521d67a8a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:12:46.160965 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: WARNING py.warnings [None req-69d2d5e5-d074-414a-aaeb-a4521d67a8a5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 17:12:46.160965 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: warnings.warn(msg) Jul 14 17:12:46.160965 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: Jul 14 17:12:46.162245 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d2d5e5-d074-414a-aaeb-a4521d67a8a5 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:12:46.187392 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 550/1114] 10.222.0.136 () {60 vars in 1157 bytes} [Thu Jul 14 17:12:46 2022] POST /identity/v3/projects => generated 380 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 17:12:46.191621 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d563f69d-a087-4b13-88f9-de821c549a31 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:12:46.202355 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d563f69d-a087-4b13-88f9-de821c549a31 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:12:46.259770 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499e39fb-af79-4694-87c1-306ec93c9fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '602fa21468b24207a8f98e92cd2c99ce', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:12:46.260448 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499e39fb-af79-4694-87c1-306ec93c9fce admin admin] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:12:46.260747 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499e39fb-af79-4694-87c1-306ec93c9fce admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:12:46.261088 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499e39fb-af79-4694-87c1-306ec93c9fce admin admin] PATH_INFO: `/v3/users` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:12:46.261813 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499e39fb-af79-4694-87c1-306ec93c9fce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:12:46.262826 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: WARNING py.warnings [None req-499e39fb-af79-4694-87c1-306ec93c9fce admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 17:12:46.262826 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: warnings.warn(msg) Jul 14 17:12:46.262826 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: Jul 14 17:12:46.264041 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499e39fb-af79-4694-87c1-306ec93c9fce admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:12:46.285462 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 565/1115] 10.222.0.136 () {60 vars in 1148 bytes} [Thu Jul 14 17:12:46 2022] POST /identity/v3/users => generated 291 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 17:12:46.289896 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d2d5e5-d074-414a-aaeb-a4521d67a8a5 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:12:46.300230 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d2d5e5-d074-414a-aaeb-a4521d67a8a5 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:12:46.305223 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98001e83-e05d-4adf-99ea-b03b33dae607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '602fa21468b24207a8f98e92cd2c99ce', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:12:46.305963 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98001e83-e05d-4adf-99ea-b03b33dae607 admin admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:12:46.306249 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98001e83-e05d-4adf-99ea-b03b33dae607 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:12:46.306529 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98001e83-e05d-4adf-99ea-b03b33dae607 admin admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:12:46.307252 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98001e83-e05d-4adf-99ea-b03b33dae607 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:12:46.308279 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: WARNING py.warnings [None req-98001e83-e05d-4adf-99ea-b03b33dae607 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 17:12:46.308279 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: warnings.warn(msg) Jul 14 17:12:46.308279 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: Jul 14 17:12:46.309174 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98001e83-e05d-4adf-99ea-b03b33dae607 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:12:46.323188 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 551/1116] 10.222.0.136 () {58 vars in 1126 bytes} [Thu Jul 14 17:12:46 2022] GET /identity/v3/roles => generated 1427 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 17:12:46.328026 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499e39fb-af79-4694-87c1-306ec93c9fce admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:12:46.338241 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499e39fb-af79-4694-87c1-306ec93c9fce admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:12:46.342854 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9f2279-511b-4e45-a1c3-2c4f563f2e57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '602fa21468b24207a8f98e92cd2c99ce', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:12:46.343505 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9f2279-511b-4e45-a1c3-2c4f563f2e57 admin admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:12:46.343792 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9f2279-511b-4e45-a1c3-2c4f563f2e57 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:12:46.344070 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9f2279-511b-4e45-a1c3-2c4f563f2e57 admin admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:12:46.344786 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9f2279-511b-4e45-a1c3-2c4f563f2e57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:12:46.345823 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: WARNING py.warnings [None req-fb9f2279-511b-4e45-a1c3-2c4f563f2e57 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 17:12:46.345823 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: warnings.warn(msg) Jul 14 17:12:46.345823 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: Jul 14 17:12:46.346736 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9f2279-511b-4e45-a1c3-2c4f563f2e57 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:12:46.360569 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 566/1117] 10.222.0.136 () {58 vars in 1126 bytes} [Thu Jul 14 17:12:46 2022] GET /identity/v3/roles => generated 1427 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 17:12:46.364807 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98001e83-e05d-4adf-99ea-b03b33dae607 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:12:46.375291 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98001e83-e05d-4adf-99ea-b03b33dae607 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:12:46.379817 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d080a825-71fc-437f-a983-741bfa55a26f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '602fa21468b24207a8f98e92cd2c99ce', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:12:46.380685 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d080a825-71fc-437f-a983-741bfa55a26f admin admin] REQUEST_METHOD: `PUT` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:12:46.380969 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d080a825-71fc-437f-a983-741bfa55a26f admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:12:46.381249 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d080a825-71fc-437f-a983-741bfa55a26f admin admin] PATH_INFO: `/v3/projects/b343482f8b574e759f37389a39dfe48b/users/8057d837509a42908683c80ea718d4c3/roles/7441b1b1ab104537addd90a2471822f3` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:12:46.396389 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d080a825-71fc-437f-a983-741bfa55a26f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b343482f8b574e759f37389a39dfe48b, user_id=8057d837509a42908683c80ea718d4c3, role_id=7441b1b1ab104537addd90a2471822f3)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:12:46.397334 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: WARNING py.warnings [None req-d080a825-71fc-437f-a983-741bfa55a26f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 17:12:46.397334 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: warnings.warn(msg) Jul 14 17:12:46.397334 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: Jul 14 17:12:46.399309 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d080a825-71fc-437f-a983-741bfa55a26f admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:12:46.412946 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 552/1118] 10.222.0.136 () {60 vars in 1487 bytes} [Thu Jul 14 17:12:46 2022] PUT /identity/v3/projects/b343482f8b574e759f37389a39dfe48b/users/8057d837509a42908683c80ea718d4c3/roles/7441b1b1ab104537addd90a2471822f3 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:12:46.425354 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211b137f-4f89-42fd-8d77-a739a8445254 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:12:46.425687 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211b137f-4f89-42fd-8d77-a739a8445254 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:12:46.425976 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211b137f-4f89-42fd-8d77-a739a8445254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:12:46.454263 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-211b137f-4f89-42fd-8d77-a739a8445254 None None] MFA Rules not processed for user `8057d837509a42908683c80ea718d4c3`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:12:46.455488 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-211b137f-4f89-42fd-8d77-a739a8445254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:12:46.523360 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 567/1119] 10.222.0.136 () {58 vars in 962 bytes} [Thu Jul 14 17:12:46 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:12:46.536265 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d838db-e7bc-4d35-b2b7-8e99b29ef829 None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:12:46.536560 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d838db-e7bc-4d35-b2b7-8e99b29ef829 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:12:46.536843 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d838db-e7bc-4d35-b2b7-8e99b29ef829 None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:12:46.538270 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 553/1120] 10.222.0.136 () {54 vars in 968 bytes} [Thu Jul 14 17:12:46 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:12:46.542954 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9f7d5e-9a8c-4228-8f59-1e645ed60027 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:12:46.543246 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9f7d5e-9a8c-4228-8f59-1e645ed60027 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:12:46.543523 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9f7d5e-9a8c-4228-8f59-1e645ed60027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:12:46.561702 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-7b9f7d5e-9a8c-4228-8f59-1e645ed60027 None None] MFA Rules not processed for user `5fc301707c5d4f759b61266af952e625`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:12:46.562871 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-7b9f7d5e-9a8c-4228-8f59-1e645ed60027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:12:46.608619 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:12:46.617328 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 568/1121] 10.222.0.136 () {58 vars in 1065 bytes} [Thu Jul 14 17:12:46 2022] POST /identity/v3/auth/tokens => generated 2678 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:12:46.624844 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d838db-e7bc-4d35-b2b7-8e99b29ef829 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:12:46.636040 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d838db-e7bc-4d35-b2b7-8e99b29ef829 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:12:46.639529 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985755b2-775a-4ecc-bcaf-b639919de10e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fc301707c5d4f759b61266af952e625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd57eaa6dbca24cbb99dce1fe3437ecae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:12:46.640202 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985755b2-775a-4ecc-bcaf-b639919de10e service cinder] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:12:46.640521 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985755b2-775a-4ecc-bcaf-b639919de10e service cinder] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:12:46.640808 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985755b2-775a-4ecc-bcaf-b639919de10e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:12:46.650276 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985755b2-775a-4ecc-bcaf-b639919de10e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:12:46.651657 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985755b2-775a-4ecc-bcaf-b639919de10e service cinder] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:12:46.660431 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 554/1122] 10.222.0.136 () {60 vars in 1370 bytes} [Thu Jul 14 17:12:46 2022] GET /identity/v3/auth/tokens => generated 2814 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:12:46.698057 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70c9525-8caa-43b1-bd2d-c257ed9f53f9 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:12:46.698357 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70c9525-8caa-43b1-bd2d-c257ed9f53f9 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:12:46.698644 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70c9525-8caa-43b1-bd2d-c257ed9f53f9 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:12:46.699922 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 569/1123] 10.222.0.136 () {52 vars in 834 bytes} [Thu Jul 14 17:12:46 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:12:46.703422 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985755b2-775a-4ecc-bcaf-b639919de10e service cinder] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:12:46.765936 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985755b2-775a-4ecc-bcaf-b639919de10e service cinder] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:12:46.770644 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f25574e-6f47-4a91-a90c-da1926837f29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '602fa21468b24207a8f98e92cd2c99ce', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:12:46.771509 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f25574e-6f47-4a91-a90c-da1926837f29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:12:46.771796 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f25574e-6f47-4a91-a90c-da1926837f29 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:12:46.772078 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f25574e-6f47-4a91-a90c-da1926837f29 admin admin] PATH_INFO: `/v3/users/8057d837509a42908683c80ea718d4c3` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:12:46.773274 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f25574e-6f47-4a91-a90c-da1926837f29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8057d837509a42908683c80ea718d4c3)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:12:46.774942 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: WARNING py.warnings [None req-0f25574e-6f47-4a91-a90c-da1926837f29 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 17:12:46.774942 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: warnings.warn(msg) Jul 14 17:12:46.774942 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: Jul 14 17:12:46.776143 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f25574e-6f47-4a91-a90c-da1926837f29 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:12:46.840234 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-0f25574e-6f47-4a91-a90c-da1926837f29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8057d837509a42908683c80ea718d4c3'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:12:46.850908 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-0f25574e-6f47-4a91-a90c-da1926837f29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8057d837509a42908683c80ea718d4c3'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:12:46.852067 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-0f25574e-6f47-4a91-a90c-da1926837f29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8057d837509a42908683c80ea718d4c3'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:12:46.864056 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-0f25574e-6f47-4a91-a90c-da1926837f29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8057d837509a42908683c80ea718d4c3'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:12:46.886064 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-0f25574e-6f47-4a91-a90c-da1926837f29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8057d837509a42908683c80ea718d4c3'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:12:46.892713 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 555/1124] 10.222.0.136 () {58 vars in 1228 bytes} [Thu Jul 14 17:12:46 2022] DELETE /identity/v3/users/8057d837509a42908683c80ea718d4c3 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:12:46.897275 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d478ba-af30-499b-92c3-6a41ed5ae5dd None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:12:46.897596 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d478ba-af30-499b-92c3-6a41ed5ae5dd None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:12:46.897888 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d478ba-af30-499b-92c3-6a41ed5ae5dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:12:46.916308 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-82d478ba-af30-499b-92c3-6a41ed5ae5dd None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:12:46.917434 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-82d478ba-af30-499b-92c3-6a41ed5ae5dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:12:46.976707 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 570/1125] 10.222.0.136 () {58 vars in 962 bytes} [Thu Jul 14 17:12:46 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:12:46.986131 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f25574e-6f47-4a91-a90c-da1926837f29 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:12:46.987520 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-0f25574e-6f47-4a91-a90c-da1926837f29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:12:46.993153 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:12:47.048831 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f25574e-6f47-4a91-a90c-da1926837f29 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:12:47.052432 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb9a55f-9ecb-4bd8-b3d7-5ec97f84eb61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8c6871e11f047e284afdb16bcb1d3a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd57eaa6dbca24cbb99dce1fe3437ecae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:12:47.053075 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb9a55f-9ecb-4bd8-b3d7-5ec97f84eb61 service neutron] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:12:47.053360 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb9a55f-9ecb-4bd8-b3d7-5ec97f84eb61 service neutron] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:12:47.053670 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb9a55f-9ecb-4bd8-b3d7-5ec97f84eb61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:12:47.063190 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb9a55f-9ecb-4bd8-b3d7-5ec97f84eb61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:12:47.064640 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb9a55f-9ecb-4bd8-b3d7-5ec97f84eb61 service neutron] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:12:47.074839 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 556/1126] 10.222.0.136 () {60 vars in 1370 bytes} [Thu Jul 14 17:12:46 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:12:47.401581 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d478ba-af30-499b-92c3-6a41ed5ae5dd None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:12:47.403058 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-82d478ba-af30-499b-92c3-6a41ed5ae5dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:12:47.415783 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d478ba-af30-499b-92c3-6a41ed5ae5dd None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:12:47.420888 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b533353-ce6f-4b9e-aa7a-350557ca5fe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '602fa21468b24207a8f98e92cd2c99ce', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:12:47.421784 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b533353-ce6f-4b9e-aa7a-350557ca5fe9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:12:47.422079 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b533353-ce6f-4b9e-aa7a-350557ca5fe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:12:47.423280 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b533353-ce6f-4b9e-aa7a-350557ca5fe9 admin admin] PATH_INFO: `/v3/projects/b343482f8b574e759f37389a39dfe48b` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:12:47.424842 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b533353-ce6f-4b9e-aa7a-350557ca5fe9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b343482f8b574e759f37389a39dfe48b)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:12:47.425900 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: WARNING py.warnings [None req-9b533353-ce6f-4b9e-aa7a-350557ca5fe9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 17:12:47.425900 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: warnings.warn(msg) Jul 14 17:12:47.425900 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: Jul 14 17:12:47.427116 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b533353-ce6f-4b9e-aa7a-350557ca5fe9 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:12:47.493468 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-9b533353-ce6f-4b9e-aa7a-350557ca5fe9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b343482f8b574e759f37389a39dfe48b', 'request_id': 'req-9b533353-ce6f-4b9e-aa7a-350557ca5fe9'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:12:47.502277 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-9b533353-ce6f-4b9e-aa7a-350557ca5fe9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b343482f8b574e759f37389a39dfe48b', 'request_id': 'req-9b533353-ce6f-4b9e-aa7a-350557ca5fe9'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:12:47.516040 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-9b533353-ce6f-4b9e-aa7a-350557ca5fe9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b343482f8b574e759f37389a39dfe48b', 'request_id': 'req-9b533353-ce6f-4b9e-aa7a-350557ca5fe9'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:12:47.527183 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-9b533353-ce6f-4b9e-aa7a-350557ca5fe9 admin admin] The token cache is being invalidate because project b343482f8b574e759f37389a39dfe48b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 17:12:47.527473 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-9b533353-ce6f-4b9e-aa7a-350557ca5fe9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:12:47.528213 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-9b533353-ce6f-4b9e-aa7a-350557ca5fe9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:12:47.529796 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 571/1127] 10.222.0.136 () {58 vars in 1237 bytes} [Thu Jul 14 17:12:47 2022] DELETE /identity/v3/projects/b343482f8b574e759f37389a39dfe48b => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:12:57.069805 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=25 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:12:57.524228 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:14:14.152247 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b22a2a0-4153-4941-a5f0-a223041fdef5 None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:14:14.152879 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b22a2a0-4153-4941-a5f0-a223041fdef5 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:14:14.152879 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b22a2a0-4153-4941-a5f0-a223041fdef5 None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:14:14.154270 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 557/1128] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 17:14:14 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:14:14.159205 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b8e9b2-5168-4606-b225-213aaf28a1e6 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:14:14.159629 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b8e9b2-5168-4606-b225-213aaf28a1e6 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:14:14.159760 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b8e9b2-5168-4606-b225-213aaf28a1e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:14:14.229906 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-13b8e9b2-5168-4606-b225-213aaf28a1e6 None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:14:14.231117 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-13b8e9b2-5168-4606-b225-213aaf28a1e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:14:14.327751 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 572/1129] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 17:14:14 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:14:14.488349 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b22a2a0-4153-4941-a5f0-a223041fdef5 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:14:14.490092 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-3b22a2a0-4153-4941-a5f0-a223041fdef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:14:14.580553 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b22a2a0-4153-4941-a5f0-a223041fdef5 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:14:14.585648 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e538de-f782-4e9a-99f6-f7626d735a4c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc2b7d015c2046ddacac6e682f22d0f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd57eaa6dbca24cbb99dce1fe3437ecae', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:14:14.586299 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e538de-f782-4e9a-99f6-f7626d735a4c service nova] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:14:14.586589 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e538de-f782-4e9a-99f6-f7626d735a4c service nova] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:14:14.586872 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e538de-f782-4e9a-99f6-f7626d735a4c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:14:14.595295 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e538de-f782-4e9a-99f6-f7626d735a4c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:14:14.596882 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e538de-f782-4e9a-99f6-f7626d735a4c service nova] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:14:14.606618 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 558/1130] 10.222.0.136 () {60 vars in 1370 bytes} [Thu Jul 14 17:14:14 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:14:15.469720 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ac1908-1711-4340-a771-8f41ee216565 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:14:15.470282 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ac1908-1711-4340-a771-8f41ee216565 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:14:15.470282 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ac1908-1711-4340-a771-8f41ee216565 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:14:15.472150 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 573/1131] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 17:14:15 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:14:15.477266 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b48bde-9231-4b65-ae0c-836204152d46 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:14:15.478031 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b48bde-9231-4b65-ae0c-836204152d46 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:14:15.478164 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b48bde-9231-4b65-ae0c-836204152d46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:14:15.502949 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-94b48bde-9231-4b65-ae0c-836204152d46 None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:14:15.504850 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-94b48bde-9231-4b65-ae0c-836204152d46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:14:15.519713 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 559/1132] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 17:14:15 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:14:15.728284 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ac1908-1711-4340-a771-8f41ee216565 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:14:15.742080 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ac1908-1711-4340-a771-8f41ee216565 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:14:15.747519 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15385c8-a615-4355-814b-6b7bf9263ce4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc2b7d015c2046ddacac6e682f22d0f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd57eaa6dbca24cbb99dce1fe3437ecae', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:14:15.748167 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15385c8-a615-4355-814b-6b7bf9263ce4 service nova] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:14:15.748459 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15385c8-a615-4355-814b-6b7bf9263ce4 service nova] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:14:15.748743 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15385c8-a615-4355-814b-6b7bf9263ce4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:14:15.757852 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15385c8-a615-4355-814b-6b7bf9263ce4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:14:15.759480 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15385c8-a615-4355-814b-6b7bf9263ce4 service nova] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:14:15.770013 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 574/1133] 10.222.0.136 () {60 vars in 1370 bytes} [Thu Jul 14 17:14:15 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:14:18.652258 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20697317-432d-49f9-a85c-3dfe3af43d54 None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:14:18.652806 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20697317-432d-49f9-a85c-3dfe3af43d54 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:14:18.652899 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20697317-432d-49f9-a85c-3dfe3af43d54 None None] PATH_INFO: `/v3` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:14:18.654204 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 560/1134] 10.222.0.107 () {54 vars in 930 bytes} [Thu Jul 14 17:14:18 2022] GET /identity/v3 => generated 256 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:14:18.660848 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fa500c-ce3d-454a-ba81-299e614c9f61 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:14:18.661298 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fa500c-ce3d-454a-ba81-299e614c9f61 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:14:18.661444 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fa500c-ce3d-454a-ba81-299e614c9f61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:14:18.691210 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-62fa500c-ce3d-454a-ba81-299e614c9f61 None None] MFA Rules not processed for user `05cdf81bd7d14730962816677457e858`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:14:18.692422 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-62fa500c-ce3d-454a-ba81-299e614c9f61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:14:18.747591 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:14:18.759153 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 575/1135] 10.222.0.107 () {58 vars in 1020 bytes} [Thu Jul 14 17:14:18 2022] POST /identity/v3/auth/tokens => generated 2866 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 17:14:25.494886 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=42 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:14:27.054777 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80fac61-6e06-40b4-bfc3-d3e967db6d86 None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:14:27.055440 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80fac61-6e06-40b4-bfc3-d3e967db6d86 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:14:27.055440 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80fac61-6e06-40b4-bfc3-d3e967db6d86 None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:14:27.056707 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 561/1136] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 17:14:27 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:14:27.062418 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9498f558-b825-4b72-a410-f2488849d1c9 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:14:27.062824 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9498f558-b825-4b72-a410-f2488849d1c9 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:14:27.062983 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9498f558-b825-4b72-a410-f2488849d1c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:14:27.083428 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-9498f558-b825-4b72-a410-f2488849d1c9 None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:14:27.083849 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-9498f558-b825-4b72-a410-f2488849d1c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:14:27.091792 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 576/1137] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 17:14:27 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:14:27.268225 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80fac61-6e06-40b4-bfc3-d3e967db6d86 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:14:27.284484 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80fac61-6e06-40b4-bfc3-d3e967db6d86 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:14:27.289752 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699e8efa-73a5-432c-b2fa-116c8fef4dd3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc2b7d015c2046ddacac6e682f22d0f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd57eaa6dbca24cbb99dce1fe3437ecae', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:14:27.290403 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699e8efa-73a5-432c-b2fa-116c8fef4dd3 service nova] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:14:27.290867 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699e8efa-73a5-432c-b2fa-116c8fef4dd3 service nova] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:14:27.291159 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699e8efa-73a5-432c-b2fa-116c8fef4dd3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:14:27.300722 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699e8efa-73a5-432c-b2fa-116c8fef4dd3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:14:27.302361 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699e8efa-73a5-432c-b2fa-116c8fef4dd3 service nova] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:14:27.312607 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 562/1138] 10.222.0.136 () {60 vars in 1370 bytes} [Thu Jul 14 17:14:27 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:14:27.696501 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc26c07-4e9a-48cb-82c9-431149ba387c None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:14:27.696994 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc26c07-4e9a-48cb-82c9-431149ba387c None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:14:27.697355 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc26c07-4e9a-48cb-82c9-431149ba387c None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:14:27.698836 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 577/1139] 10.222.0.136 () {54 vars in 965 bytes} [Thu Jul 14 17:14:27 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:14:27.704235 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a477e174-9ac2-48ef-8ff6-4f957805ab53 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:14:27.704539 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a477e174-9ac2-48ef-8ff6-4f957805ab53 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:14:27.704850 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a477e174-9ac2-48ef-8ff6-4f957805ab53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:14:27.722790 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-a477e174-9ac2-48ef-8ff6-4f957805ab53 None None] MFA Rules not processed for user `05cdf81bd7d14730962816677457e858`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:14:27.723978 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-a477e174-9ac2-48ef-8ff6-4f957805ab53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:14:27.733500 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 563/1140] 10.222.0.136 () {58 vars in 1062 bytes} [Thu Jul 14 17:14:27 2022] POST /identity/v3/auth/tokens => generated 2866 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:14:27.741069 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc26c07-4e9a-48cb-82c9-431149ba387c None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:14:27.755594 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc26c07-4e9a-48cb-82c9-431149ba387c None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:14:27.761041 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824da1a3-120f-4fc0-91c0-3ed3c2d31a06 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05cdf81bd7d14730962816677457e858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd57eaa6dbca24cbb99dce1fe3437ecae', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:14:27.761716 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824da1a3-120f-4fc0-91c0-3ed3c2d31a06 service placement] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:14:27.762060 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824da1a3-120f-4fc0-91c0-3ed3c2d31a06 service placement] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:14:27.762385 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824da1a3-120f-4fc0-91c0-3ed3c2d31a06 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:14:27.771488 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824da1a3-120f-4fc0-91c0-3ed3c2d31a06 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:14:27.773071 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824da1a3-120f-4fc0-91c0-3ed3c2d31a06 service placement] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:14:27.783118 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 578/1141] 10.222.0.136 () {60 vars in 1370 bytes} [Thu Jul 14 17:14:27 2022] GET /identity/v3/auth/tokens => generated 2866 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:14:28.166283 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb925c6-432e-43c8-8dc3-224bdee86075 None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:14:28.166893 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb925c6-432e-43c8-8dc3-224bdee86075 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:14:28.167002 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb925c6-432e-43c8-8dc3-224bdee86075 None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:14:28.168437 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 564/1142] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 17:14:28 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:14:28.174135 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb79d8a-3df3-4300-aa2d-36ae8b711563 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:14:28.174595 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb79d8a-3df3-4300-aa2d-36ae8b711563 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:14:28.174694 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb79d8a-3df3-4300-aa2d-36ae8b711563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:14:28.193029 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-6cb79d8a-3df3-4300-aa2d-36ae8b711563 None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:14:28.194340 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-6cb79d8a-3df3-4300-aa2d-36ae8b711563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:14:28.203039 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 579/1143] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 17:14:28 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:14:28.359439 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb925c6-432e-43c8-8dc3-224bdee86075 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:14:28.373766 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb925c6-432e-43c8-8dc3-224bdee86075 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:14:28.381068 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242ee46a-645f-4e5f-a46d-260794a83de7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc2b7d015c2046ddacac6e682f22d0f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd57eaa6dbca24cbb99dce1fe3437ecae', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:14:28.381624 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242ee46a-645f-4e5f-a46d-260794a83de7 service nova] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:14:28.381918 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242ee46a-645f-4e5f-a46d-260794a83de7 service nova] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:14:28.382198 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242ee46a-645f-4e5f-a46d-260794a83de7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:14:28.404824 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242ee46a-645f-4e5f-a46d-260794a83de7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:14:28.406267 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242ee46a-645f-4e5f-a46d-260794a83de7 service nova] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:14:28.416921 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 565/1144] 10.222.0.136 () {60 vars in 1370 bytes} [Thu Jul 14 17:14:28 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:14:32.823037 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9713a4-a4fc-41fa-ba65-f5a38fb18a75 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:14:32.823709 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9713a4-a4fc-41fa-ba65-f5a38fb18a75 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:14:32.823709 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9713a4-a4fc-41fa-ba65-f5a38fb18a75 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:14:32.825426 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 580/1145] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 17:14:32 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:14:32.838162 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ea0a94-688a-43a1-8d4b-3bdb762bd24a None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:14:32.838766 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ea0a94-688a-43a1-8d4b-3bdb762bd24a None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:14:32.838766 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ea0a94-688a-43a1-8d4b-3bdb762bd24a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:14:32.858639 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-51ea0a94-688a-43a1-8d4b-3bdb762bd24a None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:14:32.859843 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-51ea0a94-688a-43a1-8d4b-3bdb762bd24a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:14:32.867687 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 566/1146] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 17:14:32 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:14:32.909162 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9713a4-a4fc-41fa-ba65-f5a38fb18a75 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:14:32.910866 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-3f9713a4-a4fc-41fa-ba65-f5a38fb18a75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:14:32.970670 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9713a4-a4fc-41fa-ba65-f5a38fb18a75 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:14:32.974176 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6807a98-0d3f-4ec7-987a-a1cc3c5bfdee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8c6871e11f047e284afdb16bcb1d3a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd57eaa6dbca24cbb99dce1fe3437ecae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:14:32.974821 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6807a98-0d3f-4ec7-987a-a1cc3c5bfdee service neutron] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:14:32.975108 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6807a98-0d3f-4ec7-987a-a1cc3c5bfdee service neutron] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:14:32.975388 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6807a98-0d3f-4ec7-987a-a1cc3c5bfdee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:14:32.985123 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6807a98-0d3f-4ec7-987a-a1cc3c5bfdee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:14:32.986615 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6807a98-0d3f-4ec7-987a-a1cc3c5bfdee service neutron] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:14:32.996081 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 581/1147] 10.222.0.136 () {60 vars in 1370 bytes} [Thu Jul 14 17:14:32 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:14:35.227319 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093f2fee-a908-4747-9968-a64fa4149733 None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:14:35.227813 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093f2fee-a908-4747-9968-a64fa4149733 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:14:35.227907 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093f2fee-a908-4747-9968-a64fa4149733 None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:14:35.229522 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 567/1148] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 17:14:35 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:14:35.235168 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7b36be-209d-4482-8443-564d83c7863b None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:14:35.235567 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7b36be-209d-4482-8443-564d83c7863b None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:14:35.235729 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7b36be-209d-4482-8443-564d83c7863b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:14:35.254167 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-5b7b36be-209d-4482-8443-564d83c7863b None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:14:35.255356 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-5b7b36be-209d-4482-8443-564d83c7863b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:14:35.263308 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 582/1149] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 17:14:35 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:14:35.300146 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093f2fee-a908-4747-9968-a64fa4149733 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:14:35.312160 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093f2fee-a908-4747-9968-a64fa4149733 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:14:35.315636 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd46d89b-8635-42df-b2b1-8344c8a7c82e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8c6871e11f047e284afdb16bcb1d3a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd57eaa6dbca24cbb99dce1fe3437ecae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:14:35.316271 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd46d89b-8635-42df-b2b1-8344c8a7c82e service neutron] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:14:35.316559 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd46d89b-8635-42df-b2b1-8344c8a7c82e service neutron] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:14:35.316836 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd46d89b-8635-42df-b2b1-8344c8a7c82e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:14:35.327795 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd46d89b-8635-42df-b2b1-8344c8a7c82e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:14:35.329259 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd46d89b-8635-42df-b2b1-8344c8a7c82e service neutron] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:14:35.338672 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 568/1150] 10.222.0.136 () {60 vars in 1370 bytes} [Thu Jul 14 17:14:35 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 17:14:39.348642 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8f4d34-da79-4b71-9c3a-23384a8b08c3 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:14:39.349217 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8f4d34-da79-4b71-9c3a-23384a8b08c3 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:14:39.349217 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8f4d34-da79-4b71-9c3a-23384a8b08c3 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:14:39.350624 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 583/1151] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 17:14:39 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:14:39.356192 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df3f5f8-9738-4648-94cf-1dd2239d5478 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:14:39.357302 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df3f5f8-9738-4648-94cf-1dd2239d5478 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:14:39.357302 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df3f5f8-9738-4648-94cf-1dd2239d5478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:14:39.375187 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-1df3f5f8-9738-4648-94cf-1dd2239d5478 None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:14:39.376369 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-1df3f5f8-9738-4648-94cf-1dd2239d5478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:14:39.384079 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 569/1152] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 17:14:39 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:14:39.656213 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8f4d34-da79-4b71-9c3a-23384a8b08c3 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:14:39.657933 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-4e8f4d34-da79-4b71-9c3a-23384a8b08c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:14:39.715244 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8f4d34-da79-4b71-9c3a-23384a8b08c3 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:14:39.719529 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2f7064-d9cf-4f20-87a6-86454bfc4b80 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fc301707c5d4f759b61266af952e625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd57eaa6dbca24cbb99dce1fe3437ecae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:14:39.720169 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2f7064-d9cf-4f20-87a6-86454bfc4b80 service cinder] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:14:39.720457 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2f7064-d9cf-4f20-87a6-86454bfc4b80 service cinder] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:14:39.720736 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2f7064-d9cf-4f20-87a6-86454bfc4b80 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:14:39.729846 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2f7064-d9cf-4f20-87a6-86454bfc4b80 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:14:39.731268 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2f7064-d9cf-4f20-87a6-86454bfc4b80 service cinder] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:14:39.740585 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 584/1153] 10.222.0.136 () {60 vars in 1370 bytes} [Thu Jul 14 17:14:39 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:14:42.027700 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4619b592-fe6d-4796-87cb-4ed63011a2d6 None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:14:42.028389 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4619b592-fe6d-4796-87cb-4ed63011a2d6 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:14:42.028389 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4619b592-fe6d-4796-87cb-4ed63011a2d6 None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:14:42.029698 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 570/1154] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 17:14:42 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:14:42.035005 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a620431-a9cb-49c6-af92-bd758ff0e827 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:14:42.035485 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a620431-a9cb-49c6-af92-bd758ff0e827 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:14:42.035655 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a620431-a9cb-49c6-af92-bd758ff0e827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:14:42.055690 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-6a620431-a9cb-49c6-af92-bd758ff0e827 None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:14:42.056904 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-6a620431-a9cb-49c6-af92-bd758ff0e827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:14:42.065602 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 585/1155] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 17:14:42 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:14:42.341414 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4619b592-fe6d-4796-87cb-4ed63011a2d6 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:14:42.343214 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-4619b592-fe6d-4796-87cb-4ed63011a2d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:14:42.356463 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4619b592-fe6d-4796-87cb-4ed63011a2d6 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:14:42.360495 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dc838f-98cd-4115-825e-790a83710ba0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fc301707c5d4f759b61266af952e625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd57eaa6dbca24cbb99dce1fe3437ecae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:14:42.361130 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dc838f-98cd-4115-825e-790a83710ba0 service cinder] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:14:42.361419 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dc838f-98cd-4115-825e-790a83710ba0 service cinder] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:14:42.361738 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dc838f-98cd-4115-825e-790a83710ba0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:14:42.370716 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dc838f-98cd-4115-825e-790a83710ba0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:14:42.372319 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dc838f-98cd-4115-825e-790a83710ba0 service cinder] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:14:42.381847 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 571/1156] 10.222.0.136 () {60 vars in 1370 bytes} [Thu Jul 14 17:14:42 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:14:52.050973 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=70 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:14:52.377718 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=33 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:16:04.148081 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e3f801-4001-4a76-a15c-f3989c9daa47 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:16:04.148724 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e3f801-4001-4a76-a15c-f3989c9daa47 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:16:04.148724 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e3f801-4001-4a76-a15c-f3989c9daa47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:16:04.167414 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83b8272-f911-4767-8b72-4bb58fb64dc0 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:16:04.168015 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-19e3f801-4001-4a76-a15c-f3989c9daa47 None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:16:04.168128 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83b8272-f911-4767-8b72-4bb58fb64dc0 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:16:04.168128 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83b8272-f911-4767-8b72-4bb58fb64dc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:16:04.168931 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-19e3f801-4001-4a76-a15c-f3989c9daa47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:16:04.176844 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 586/1157] 10.222.0.136 () {58 vars in 962 bytes} [Thu Jul 14 17:16:04 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:16:04.184978 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e8a8eb-a9e3-4522-81d1-534cf44f51d2 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:16:04.185292 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e8a8eb-a9e3-4522-81d1-534cf44f51d2 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:16:04.185631 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e8a8eb-a9e3-4522-81d1-534cf44f51d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:16:04.186482 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-c83b8272-f911-4767-8b72-4bb58fb64dc0 None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:16:04.187760 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-c83b8272-f911-4767-8b72-4bb58fb64dc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:16:04.196951 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 572/1158] 10.222.0.136 () {58 vars in 962 bytes} [Thu Jul 14 17:16:04 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 17:16:04.205163 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-26e8a8eb-a9e3-4522-81d1-534cf44f51d2 None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:16:04.205503 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1636b942-f5ac-4a6d-9ce0-e8f6113c2fd7 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:16:04.205840 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1636b942-f5ac-4a6d-9ce0-e8f6113c2fd7 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:16:04.206129 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1636b942-f5ac-4a6d-9ce0-e8f6113c2fd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:16:04.206402 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-26e8a8eb-a9e3-4522-81d1-534cf44f51d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:16:04.214228 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 587/1159] 10.222.0.136 () {58 vars in 962 bytes} [Thu Jul 14 17:16:04 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 17:16:04.218807 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e8a8eb-a9e3-4522-81d1-534cf44f51d2 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:16:04.224196 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-1636b942-f5ac-4a6d-9ce0-e8f6113c2fd7 None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:16:04.225396 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-1636b942-f5ac-4a6d-9ce0-e8f6113c2fd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:16:04.228458 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e8a8eb-a9e3-4522-81d1-534cf44f51d2 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:16:04.233362 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aa3665-7edd-423c-8e60-cda0aae48f47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '602fa21468b24207a8f98e92cd2c99ce', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:16:04.233588 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 573/1160] 10.222.0.136 () {58 vars in 962 bytes} [Thu Jul 14 17:16:04 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 17:16:04.234052 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aa3665-7edd-423c-8e60-cda0aae48f47 admin admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:16:04.234396 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aa3665-7edd-423c-8e60-cda0aae48f47 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:16:04.234680 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aa3665-7edd-423c-8e60-cda0aae48f47 admin admin] PATH_INFO: `/v3/domains` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:16:04.236285 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34aa3665-7edd-423c-8e60-cda0aae48f47 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:16:04.236709 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34aa3665-7edd-423c-8e60-cda0aae48f47 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:16:04.238343 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1636b942-f5ac-4a6d-9ce0-e8f6113c2fd7 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:16:04.238478 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34aa3665-7edd-423c-8e60-cda0aae48f47 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:16:04.247268 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1636b942-f5ac-4a6d-9ce0-e8f6113c2fd7 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:16:04.257642 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 588/1161] 10.222.0.136 () {58 vars in 1157 bytes} [Thu Jul 14 17:16:04 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 17:16:04.257808 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eae49b-ecea-4626-8b21-564467d59eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '602fa21468b24207a8f98e92cd2c99ce', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:16:04.257808 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eae49b-ecea-4626-8b21-564467d59eca admin admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:16:04.257808 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eae49b-ecea-4626-8b21-564467d59eca admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:16:04.257808 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eae49b-ecea-4626-8b21-564467d59eca admin admin] PATH_INFO: `/v3/domains` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:16:04.258198 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64eae49b-ecea-4626-8b21-564467d59eca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:16:04.258198 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64eae49b-ecea-4626-8b21-564467d59eca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:16:04.258198 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: WARNING py.warnings [None req-64eae49b-ecea-4626-8b21-564467d59eca admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 17:16:04.258198 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: warnings.warn(msg) Jul 14 17:16:04.258198 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: Jul 14 17:16:04.258198 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64eae49b-ecea-4626-8b21-564467d59eca admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:16:04.259601 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aa3665-7edd-423c-8e60-cda0aae48f47 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:16:04.269048 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 574/1162] 10.222.0.136 () {58 vars in 1157 bytes} [Thu Jul 14 17:16:04 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 17:16:04.269525 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aa3665-7edd-423c-8e60-cda0aae48f47 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:16:04.274169 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33cbe4a-d697-4c02-976a-98b7a1daec1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '602fa21468b24207a8f98e92cd2c99ce', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:16:04.274815 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33cbe4a-d697-4c02-976a-98b7a1daec1e admin admin] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:16:04.275101 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33cbe4a-d697-4c02-976a-98b7a1daec1e admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:16:04.275380 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33cbe4a-d697-4c02-976a-98b7a1daec1e admin admin] PATH_INFO: `/v3/projects` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:16:04.276109 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33cbe4a-d697-4c02-976a-98b7a1daec1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:16:04.276858 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eae49b-ecea-4626-8b21-564467d59eca admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:16:04.277118 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: WARNING py.warnings [None req-b33cbe4a-d697-4c02-976a-98b7a1daec1e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 17:16:04.277118 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: warnings.warn(msg) Jul 14 17:16:04.277118 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: Jul 14 17:16:04.278335 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33cbe4a-d697-4c02-976a-98b7a1daec1e admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:16:04.286624 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eae49b-ecea-4626-8b21-564467d59eca admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:16:04.291791 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94647e1d-f478-4314-9329-4eb1e8e77f18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '602fa21468b24207a8f98e92cd2c99ce', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:16:04.292433 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94647e1d-f478-4314-9329-4eb1e8e77f18 admin admin] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:16:04.292717 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94647e1d-f478-4314-9329-4eb1e8e77f18 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:16:04.292993 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94647e1d-f478-4314-9329-4eb1e8e77f18 admin admin] PATH_INFO: `/v3/projects` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:16:04.293712 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94647e1d-f478-4314-9329-4eb1e8e77f18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:16:04.295611 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94647e1d-f478-4314-9329-4eb1e8e77f18 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:16:04.315885 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 589/1163] 10.222.0.136 () {60 vars in 1157 bytes} [Thu Jul 14 17:16:04 2022] POST /identity/v3/projects => generated 380 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 17:16:04.320274 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33cbe4a-d697-4c02-976a-98b7a1daec1e admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:16:04.328152 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 575/1164] 10.222.0.136 () {60 vars in 1157 bytes} [Thu Jul 14 17:16:04 2022] POST /identity/v3/projects => generated 380 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 17:16:04.329293 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94647e1d-f478-4314-9329-4eb1e8e77f18 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:16:04.394290 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94647e1d-f478-4314-9329-4eb1e8e77f18 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:16:04.399402 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfc9ae4-100d-473c-8023-4ad8862522d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '602fa21468b24207a8f98e92cd2c99ce', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:16:04.399557 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33cbe4a-d697-4c02-976a-98b7a1daec1e admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:16:04.400008 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfc9ae4-100d-473c-8023-4ad8862522d5 admin admin] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:16:04.400294 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfc9ae4-100d-473c-8023-4ad8862522d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:16:04.400567 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfc9ae4-100d-473c-8023-4ad8862522d5 admin admin] PATH_INFO: `/v3/users` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:16:04.401274 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfc9ae4-100d-473c-8023-4ad8862522d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:16:04.402347 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: WARNING py.warnings [None req-0cfc9ae4-100d-473c-8023-4ad8862522d5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 17:16:04.402347 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: warnings.warn(msg) Jul 14 17:16:04.402347 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: Jul 14 17:16:04.403547 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfc9ae4-100d-473c-8023-4ad8862522d5 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:16:04.404144 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a420fe34-8d63-421a-a026-c7b6ecdb49e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '602fa21468b24207a8f98e92cd2c99ce', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:16:04.404804 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a420fe34-8d63-421a-a026-c7b6ecdb49e7 admin admin] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:16:04.405130 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a420fe34-8d63-421a-a026-c7b6ecdb49e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:16:04.405399 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a420fe34-8d63-421a-a026-c7b6ecdb49e7 admin admin] PATH_INFO: `/v3/users` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:16:04.406111 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a420fe34-8d63-421a-a026-c7b6ecdb49e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:16:04.408575 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a420fe34-8d63-421a-a026-c7b6ecdb49e7 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:16:04.425620 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 576/1165] 10.222.0.136 () {60 vars in 1148 bytes} [Thu Jul 14 17:16:04 2022] POST /identity/v3/users => generated 291 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 17:16:04.429634 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfc9ae4-100d-473c-8023-4ad8862522d5 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:16:04.429991 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 590/1166] 10.222.0.136 () {60 vars in 1148 bytes} [Thu Jul 14 17:16:04 2022] POST /identity/v3/users => generated 291 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 17:16:04.433744 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a420fe34-8d63-421a-a026-c7b6ecdb49e7 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:16:04.440071 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfc9ae4-100d-473c-8023-4ad8862522d5 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:16:04.443701 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a420fe34-8d63-421a-a026-c7b6ecdb49e7 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:16:04.445102 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8accce4-c107-48cd-8dbc-aff931faf6fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '602fa21468b24207a8f98e92cd2c99ce', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:16:04.445801 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8accce4-c107-48cd-8dbc-aff931faf6fd admin admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:16:04.446086 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8accce4-c107-48cd-8dbc-aff931faf6fd admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:16:04.446445 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8accce4-c107-48cd-8dbc-aff931faf6fd admin admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:16:04.447180 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8accce4-c107-48cd-8dbc-aff931faf6fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:16:04.448458 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358d7f88-b410-4db7-b5ad-4312119a76ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '602fa21468b24207a8f98e92cd2c99ce', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:16:04.448765 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8accce4-c107-48cd-8dbc-aff931faf6fd admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:16:04.449104 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358d7f88-b410-4db7-b5ad-4312119a76ef admin admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:16:04.449388 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358d7f88-b410-4db7-b5ad-4312119a76ef admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:16:04.449697 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358d7f88-b410-4db7-b5ad-4312119a76ef admin admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:16:04.450459 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358d7f88-b410-4db7-b5ad-4312119a76ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:16:04.452017 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358d7f88-b410-4db7-b5ad-4312119a76ef admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:16:04.460061 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 577/1167] 10.222.0.136 () {58 vars in 1126 bytes} [Thu Jul 14 17:16:04 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 17:16:04.465159 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 591/1168] 10.222.0.136 () {58 vars in 1126 bytes} [Thu Jul 14 17:16:04 2022] GET /identity/v3/roles => generated 1427 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 17:16:04.465303 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8accce4-c107-48cd-8dbc-aff931faf6fd admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:16:04.466180 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358d7f88-b410-4db7-b5ad-4312119a76ef admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:16:04.476498 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8accce4-c107-48cd-8dbc-aff931faf6fd admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:16:04.477308 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358d7f88-b410-4db7-b5ad-4312119a76ef admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:16:04.481577 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435e72fd-a862-4e8c-84c8-02b9a7b092d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '602fa21468b24207a8f98e92cd2c99ce', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:16:04.482129 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f1c8a6-870b-4444-977b-ec0a9e1a0fc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '602fa21468b24207a8f98e92cd2c99ce', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:16:04.482250 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435e72fd-a862-4e8c-84c8-02b9a7b092d7 admin admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:16:04.482509 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435e72fd-a862-4e8c-84c8-02b9a7b092d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:16:04.482784 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f1c8a6-870b-4444-977b-ec0a9e1a0fc7 admin admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:16:04.482891 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435e72fd-a862-4e8c-84c8-02b9a7b092d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:16:04.483066 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f1c8a6-870b-4444-977b-ec0a9e1a0fc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:16:04.483359 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f1c8a6-870b-4444-977b-ec0a9e1a0fc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:16:04.483496 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435e72fd-a862-4e8c-84c8-02b9a7b092d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:16:04.484074 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f1c8a6-870b-4444-977b-ec0a9e1a0fc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:16:04.485150 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435e72fd-a862-4e8c-84c8-02b9a7b092d7 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:16:04.486007 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f1c8a6-870b-4444-977b-ec0a9e1a0fc7 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:16:04.496457 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 578/1169] 10.222.0.136 () {58 vars in 1126 bytes} [Thu Jul 14 17:16:04 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 17:16:04.496710 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 592/1170] 10.222.0.136 () {58 vars in 1126 bytes} [Thu Jul 14 17:16:04 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 17:16:04.499899 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435e72fd-a862-4e8c-84c8-02b9a7b092d7 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:16:04.500325 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f1c8a6-870b-4444-977b-ec0a9e1a0fc7 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:16:04.510014 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435e72fd-a862-4e8c-84c8-02b9a7b092d7 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:16:04.510184 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f1c8a6-870b-4444-977b-ec0a9e1a0fc7 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:16:04.514590 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4879c3a-d700-420d-9938-10ee1796e4e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '602fa21468b24207a8f98e92cd2c99ce', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:16:04.514850 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe728db-446b-430e-bd08-d0a857f51a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '602fa21468b24207a8f98e92cd2c99ce', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:16:04.515476 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4879c3a-d700-420d-9938-10ee1796e4e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:16:04.515718 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe728db-446b-430e-bd08-d0a857f51a5d admin admin] REQUEST_METHOD: `PUT` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:16:04.515827 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4879c3a-d700-420d-9938-10ee1796e4e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:16:04.516005 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe728db-446b-430e-bd08-d0a857f51a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:16:04.516124 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4879c3a-d700-420d-9938-10ee1796e4e3 admin admin] PATH_INFO: `/v3/projects/d6ab0f5b6d5b4041903e867a33cb7a5c/users/6129f495e1214cc9b7cb922096858c34/roles/7441b1b1ab104537addd90a2471822f3` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:16:04.516835 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe728db-446b-430e-bd08-d0a857f51a5d admin admin] PATH_INFO: `/v3/projects/3ea1361195c1413a880c938483d78615/users/ad993fdaa8f344d4819c9abca449f144/roles/7441b1b1ab104537addd90a2471822f3` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:16:04.531080 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4879c3a-d700-420d-9938-10ee1796e4e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6ab0f5b6d5b4041903e867a33cb7a5c, user_id=6129f495e1214cc9b7cb922096858c34, role_id=7441b1b1ab104537addd90a2471822f3)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:16:04.531527 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe728db-446b-430e-bd08-d0a857f51a5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ea1361195c1413a880c938483d78615, user_id=ad993fdaa8f344d4819c9abca449f144, role_id=7441b1b1ab104537addd90a2471822f3)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:16:04.532700 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: WARNING py.warnings [None req-e4879c3a-d700-420d-9938-10ee1796e4e3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 17:16:04.532700 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: warnings.warn(msg) Jul 14 17:16:04.532700 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: Jul 14 17:16:04.534660 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4879c3a-d700-420d-9938-10ee1796e4e3 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:16:04.534894 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe728db-446b-430e-bd08-d0a857f51a5d admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:16:04.547678 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 593/1171] 10.222.0.136 () {60 vars in 1487 bytes} [Thu Jul 14 17:16:04 2022] PUT /identity/v3/projects/d6ab0f5b6d5b4041903e867a33cb7a5c/users/6129f495e1214cc9b7cb922096858c34/roles/7441b1b1ab104537addd90a2471822f3 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:16:04.551969 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 579/1172] 10.222.0.136 () {60 vars in 1487 bytes} [Thu Jul 14 17:16:04 2022] PUT /identity/v3/projects/3ea1361195c1413a880c938483d78615/users/ad993fdaa8f344d4819c9abca449f144/roles/7441b1b1ab104537addd90a2471822f3 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 17:16:04.555716 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7db774a-9892-4923-b9e4-ad676e6cff64 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:16:04.555716 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7db774a-9892-4923-b9e4-ad676e6cff64 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:16:04.555716 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7db774a-9892-4923-b9e4-ad676e6cff64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:16:04.556915 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc0422f-6603-4c1d-8985-e9fabe9fbd1a None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:16:04.557226 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc0422f-6603-4c1d-8985-e9fabe9fbd1a None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:16:04.557505 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc0422f-6603-4c1d-8985-e9fabe9fbd1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:16:04.570410 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-e7db774a-9892-4923-b9e4-ad676e6cff64 None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:16:04.571607 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-e7db774a-9892-4923-b9e4-ad676e6cff64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:16:04.576145 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-0cc0422f-6603-4c1d-8985-e9fabe9fbd1a None None] MFA Rules not processed for user `2178b080bea24cb2a1f6b50c1554ccd2`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:16:04.577351 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-0cc0422f-6603-4c1d-8985-e9fabe9fbd1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:16:04.615285 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:16:04.627674 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:16:04.634722 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 594/1173] 10.222.0.136 () {58 vars in 962 bytes} [Thu Jul 14 17:16:04 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 17:16:04.639816 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 580/1174] 10.222.0.136 () {58 vars in 962 bytes} [Thu Jul 14 17:16:04 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:16:04.646229 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7db774a-9892-4923-b9e4-ad676e6cff64 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:16:04.647694 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-e7db774a-9892-4923-b9e4-ad676e6cff64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:16:04.649907 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc0422f-6603-4c1d-8985-e9fabe9fbd1a None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:16:04.706481 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc0422f-6603-4c1d-8985-e9fabe9fbd1a None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:16:04.710088 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426be2fd-18de-4adb-9d00-5e85b304e6fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8c6871e11f047e284afdb16bcb1d3a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd57eaa6dbca24cbb99dce1fe3437ecae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:16:04.710735 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426be2fd-18de-4adb-9d00-5e85b304e6fc service neutron] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:16:04.711017 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426be2fd-18de-4adb-9d00-5e85b304e6fc service neutron] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:16:04.711293 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426be2fd-18de-4adb-9d00-5e85b304e6fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:16:04.716714 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7db774a-9892-4923-b9e4-ad676e6cff64 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:16:04.720541 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3717df-6be8-4b5b-a0e1-76be138a0a98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8c6871e11f047e284afdb16bcb1d3a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd57eaa6dbca24cbb99dce1fe3437ecae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:16:04.721194 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3717df-6be8-4b5b-a0e1-76be138a0a98 service neutron] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:16:04.721477 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3717df-6be8-4b5b-a0e1-76be138a0a98 service neutron] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:16:04.721659 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426be2fd-18de-4adb-9d00-5e85b304e6fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:16:04.721962 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3717df-6be8-4b5b-a0e1-76be138a0a98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:16:04.723076 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426be2fd-18de-4adb-9d00-5e85b304e6fc service neutron] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:16:04.731528 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3717df-6be8-4b5b-a0e1-76be138a0a98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:16:04.732937 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3717df-6be8-4b5b-a0e1-76be138a0a98 service neutron] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:16:04.733056 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 581/1175] 10.222.0.136 () {60 vars in 1370 bytes} [Thu Jul 14 17:16:04 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 17:16:04.743016 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 595/1176] 10.222.0.136 () {60 vars in 1370 bytes} [Thu Jul 14 17:16:04 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:16:10.149475 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5f7b41-a10d-4118-868f-e6ef683d8951 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:16:10.150008 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5f7b41-a10d-4118-868f-e6ef683d8951 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:16:10.150008 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5f7b41-a10d-4118-868f-e6ef683d8951 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:16:10.201996 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-5a5f7b41-a10d-4118-868f-e6ef683d8951 None None] MFA Rules not processed for user `6129f495e1214cc9b7cb922096858c34`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:16:10.203372 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-5a5f7b41-a10d-4118-868f-e6ef683d8951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:16:10.297083 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e4d4d8-cb22-4fb6-9420-bb13deec9ce2 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:16:10.297853 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e4d4d8-cb22-4fb6-9420-bb13deec9ce2 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:16:10.297853 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e4d4d8-cb22-4fb6-9420-bb13deec9ce2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:16:10.317637 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 582/1177] 10.222.0.136 () {58 vars in 962 bytes} [Thu Jul 14 17:16:10 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:16:10.321952 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5f7b41-a10d-4118-868f-e6ef683d8951 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:16:10.327648 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-c1e4d4d8-cb22-4fb6-9420-bb13deec9ce2 None None] MFA Rules not processed for user `ad993fdaa8f344d4819c9abca449f144`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:16:10.330362 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-c1e4d4d8-cb22-4fb6-9420-bb13deec9ce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:16:10.340680 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5f7b41-a10d-4118-868f-e6ef683d8951 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:16:10.346610 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c907e1d8-7708-4d86-a7b4-4d231cc0bd58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '602fa21468b24207a8f98e92cd2c99ce', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:16:10.349305 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c907e1d8-7708-4d86-a7b4-4d231cc0bd58 admin admin] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:16:10.349835 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c907e1d8-7708-4d86-a7b4-4d231cc0bd58 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:16:10.352825 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c907e1d8-7708-4d86-a7b4-4d231cc0bd58 admin admin] PATH_INFO: `/v3/projects` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:16:10.353765 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c907e1d8-7708-4d86-a7b4-4d231cc0bd58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:16:10.356083 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c907e1d8-7708-4d86-a7b4-4d231cc0bd58 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:16:10.389961 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 583/1178] 10.222.0.136 () {60 vars in 1157 bytes} [Thu Jul 14 17:16:10 2022] POST /identity/v3/projects => generated 378 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 17:16:10.395001 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c907e1d8-7708-4d86-a7b4-4d231cc0bd58 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:16:10.417477 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 596/1179] 10.222.0.136 () {58 vars in 962 bytes} [Thu Jul 14 17:16:10 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 17:16:10.421635 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e4d4d8-cb22-4fb6-9420-bb13deec9ce2 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:16:10.434631 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e4d4d8-cb22-4fb6-9420-bb13deec9ce2 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:16:10.476024 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c907e1d8-7708-4d86-a7b4-4d231cc0bd58 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:16:10.486101 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449a166c-f3da-453a-a9d4-9c3e1ecc4c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '602fa21468b24207a8f98e92cd2c99ce', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:16:10.488021 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449a166c-f3da-453a-a9d4-9c3e1ecc4c8e admin admin] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:16:10.489062 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449a166c-f3da-453a-a9d4-9c3e1ecc4c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:16:10.489423 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449a166c-f3da-453a-a9d4-9c3e1ecc4c8e admin admin] PATH_INFO: `/v3/users` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:16:10.490391 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449a166c-f3da-453a-a9d4-9c3e1ecc4c8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:16:10.493630 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449a166c-f3da-453a-a9d4-9c3e1ecc4c8e admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:16:10.505852 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:16:10.511326 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38958ee9-19ac-424e-ac08-fc39d9e0a9d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '602fa21468b24207a8f98e92cd2c99ce', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:16:10.512103 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38958ee9-19ac-424e-ac08-fc39d9e0a9d7 admin admin] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:16:10.512463 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38958ee9-19ac-424e-ac08-fc39d9e0a9d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:16:10.512762 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38958ee9-19ac-424e-ac08-fc39d9e0a9d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:16:10.513580 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38958ee9-19ac-424e-ac08-fc39d9e0a9d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:16:10.515579 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38958ee9-19ac-424e-ac08-fc39d9e0a9d7 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:16:10.521591 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 584/1180] 10.222.0.136 () {60 vars in 1148 bytes} [Thu Jul 14 17:16:10 2022] POST /identity/v3/users => generated 296 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 17:16:10.525130 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449a166c-f3da-453a-a9d4-9c3e1ecc4c8e admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:16:10.530819 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:16:10.536725 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449a166c-f3da-453a-a9d4-9c3e1ecc4c8e admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:16:10.542880 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39efafb2-3ed8-49da-8e5f-379e38df01c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '602fa21468b24207a8f98e92cd2c99ce', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:16:10.543975 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39efafb2-3ed8-49da-8e5f-379e38df01c1 admin admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:16:10.544303 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39efafb2-3ed8-49da-8e5f-379e38df01c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:16:10.544686 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39efafb2-3ed8-49da-8e5f-379e38df01c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:16:10.545535 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39efafb2-3ed8-49da-8e5f-379e38df01c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:16:10.547230 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39efafb2-3ed8-49da-8e5f-379e38df01c1 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:16:10.557712 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 597/1181] 10.222.0.136 () {60 vars in 1157 bytes} [Thu Jul 14 17:16:10 2022] POST /identity/v3/projects => generated 384 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 17:16:10.560049 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 585/1182] 10.222.0.136 () {58 vars in 1126 bytes} [Thu Jul 14 17:16:10 2022] GET /identity/v3/roles => generated 1427 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 17:16:10.561439 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38958ee9-19ac-424e-ac08-fc39d9e0a9d7 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:16:10.564374 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39efafb2-3ed8-49da-8e5f-379e38df01c1 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:16:10.574953 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39efafb2-3ed8-49da-8e5f-379e38df01c1 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:16:10.638791 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e37b87b-326d-43ca-a09b-d2e84d2a6c84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '602fa21468b24207a8f98e92cd2c99ce', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:16:10.639536 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38958ee9-19ac-424e-ac08-fc39d9e0a9d7 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:16:10.639992 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e37b87b-326d-43ca-a09b-d2e84d2a6c84 admin admin] REQUEST_METHOD: `PUT` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:16:10.640292 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e37b87b-326d-43ca-a09b-d2e84d2a6c84 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:16:10.640665 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e37b87b-326d-43ca-a09b-d2e84d2a6c84 admin admin] PATH_INFO: `/v3/projects/a5ec99bbe4b84e9d8775bc073d4c6b41/users/4fb471ce708f45a7ad6cf36902ff6cf1/roles/284c6314b4d3492085e397a87b0e3b51` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:16:10.645816 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f2368a-6fbe-405c-8db7-e079088b8d90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '602fa21468b24207a8f98e92cd2c99ce', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:16:10.646485 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f2368a-6fbe-405c-8db7-e079088b8d90 admin admin] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:16:10.646767 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f2368a-6fbe-405c-8db7-e079088b8d90 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:16:10.647103 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f2368a-6fbe-405c-8db7-e079088b8d90 admin admin] PATH_INFO: `/v3/users` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:16:10.647719 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f2368a-6fbe-405c-8db7-e079088b8d90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:16:10.655425 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f2368a-6fbe-405c-8db7-e079088b8d90 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:16:10.672000 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e37b87b-326d-43ca-a09b-d2e84d2a6c84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5ec99bbe4b84e9d8775bc073d4c6b41, user_id=4fb471ce708f45a7ad6cf36902ff6cf1, role_id=284c6314b4d3492085e397a87b0e3b51)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:16:10.675899 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e37b87b-326d-43ca-a09b-d2e84d2a6c84 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:16:10.692868 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 598/1183] 10.222.0.136 () {60 vars in 1148 bytes} [Thu Jul 14 17:16:10 2022] POST /identity/v3/users => generated 299 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 17:16:10.697151 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f2368a-6fbe-405c-8db7-e079088b8d90 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:16:10.699698 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 586/1184] 10.222.0.136 () {60 vars in 1487 bytes} [Thu Jul 14 17:16:10 2022] PUT /identity/v3/projects/a5ec99bbe4b84e9d8775bc073d4c6b41/users/4fb471ce708f45a7ad6cf36902ff6cf1/roles/284c6314b4d3492085e397a87b0e3b51 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 17:16:10.703375 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e37b87b-326d-43ca-a09b-d2e84d2a6c84 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:16:10.712473 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f2368a-6fbe-405c-8db7-e079088b8d90 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:16:10.776507 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e37b87b-326d-43ca-a09b-d2e84d2a6c84 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:16:10.780695 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfaa71a-9153-4868-a83e-e4c0465a101a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '602fa21468b24207a8f98e92cd2c99ce', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:16:10.781379 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfaa71a-9153-4868-a83e-e4c0465a101a admin admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:16:10.781705 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfaa71a-9153-4868-a83e-e4c0465a101a admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:16:10.782771 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfaa71a-9153-4868-a83e-e4c0465a101a admin admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:16:10.783196 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389c0318-c9b0-4b60-9bd2-1322c79b6cb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '602fa21468b24207a8f98e92cd2c99ce', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:16:10.783614 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfaa71a-9153-4868-a83e-e4c0465a101a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:16:10.784128 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389c0318-c9b0-4b60-9bd2-1322c79b6cb2 admin admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:16:10.784663 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389c0318-c9b0-4b60-9bd2-1322c79b6cb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:16:10.785055 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389c0318-c9b0-4b60-9bd2-1322c79b6cb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:16:10.785477 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfaa71a-9153-4868-a83e-e4c0465a101a admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:16:10.786090 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389c0318-c9b0-4b60-9bd2-1322c79b6cb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:16:10.787934 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389c0318-c9b0-4b60-9bd2-1322c79b6cb2 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:16:10.798710 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 599/1185] 10.222.0.136 () {58 vars in 1126 bytes} [Thu Jul 14 17:16:10 2022] GET /identity/v3/roles => generated 1427 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 17:16:10.802116 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 587/1186] 10.222.0.136 () {58 vars in 1126 bytes} [Thu Jul 14 17:16:10 2022] GET /identity/v3/roles => generated 1427 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 17:16:10.802893 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfaa71a-9153-4868-a83e-e4c0465a101a admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:16:10.805893 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389c0318-c9b0-4b60-9bd2-1322c79b6cb2 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:16:10.816487 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389c0318-c9b0-4b60-9bd2-1322c79b6cb2 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:16:10.816675 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfaa71a-9153-4868-a83e-e4c0465a101a admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:16:10.821319 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8498fd8c-f0d3-4f18-88d3-bfcc26a94374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '602fa21468b24207a8f98e92cd2c99ce', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:16:10.822013 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa144eea-bc4a-4ea5-9271-74aaee3e2624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '602fa21468b24207a8f98e92cd2c99ce', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:16:10.822445 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8498fd8c-f0d3-4f18-88d3-bfcc26a94374 admin admin] REQUEST_METHOD: `PUT` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:16:10.822566 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8498fd8c-f0d3-4f18-88d3-bfcc26a94374 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:16:10.822760 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8498fd8c-f0d3-4f18-88d3-bfcc26a94374 admin admin] PATH_INFO: `/v3/projects/3db704d8162849e69dd833963a006a2a/users/cb7e30c5b64247c79a373b66c79f343d/roles/284c6314b4d3492085e397a87b0e3b51` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:16:10.823223 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa144eea-bc4a-4ea5-9271-74aaee3e2624 admin admin] REQUEST_METHOD: `PUT` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:16:10.823600 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa144eea-bc4a-4ea5-9271-74aaee3e2624 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:16:10.823972 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa144eea-bc4a-4ea5-9271-74aaee3e2624 admin admin] PATH_INFO: `/v3/projects/a5ec99bbe4b84e9d8775bc073d4c6b41/users/4fb471ce708f45a7ad6cf36902ff6cf1/roles/284c6314b4d3492085e397a87b0e3b51` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:16:10.826208 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa144eea-bc4a-4ea5-9271-74aaee3e2624 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5ec99bbe4b84e9d8775bc073d4c6b41, user_id=4fb471ce708f45a7ad6cf36902ff6cf1, role_id=284c6314b4d3492085e397a87b0e3b51)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:16:10.829796 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa144eea-bc4a-4ea5-9271-74aaee3e2624 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:16:10.839914 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8498fd8c-f0d3-4f18-88d3-bfcc26a94374 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3db704d8162849e69dd833963a006a2a, user_id=cb7e30c5b64247c79a373b66c79f343d, role_id=284c6314b4d3492085e397a87b0e3b51)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:16:10.841943 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 588/1187] 10.222.0.136 () {60 vars in 1487 bytes} [Thu Jul 14 17:16:10 2022] PUT /identity/v3/projects/a5ec99bbe4b84e9d8775bc073d4c6b41/users/4fb471ce708f45a7ad6cf36902ff6cf1/roles/284c6314b4d3492085e397a87b0e3b51 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:16:10.842915 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8498fd8c-f0d3-4f18-88d3-bfcc26a94374 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:16:10.868128 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 600/1188] 10.222.0.136 () {60 vars in 1487 bytes} [Thu Jul 14 17:16:10 2022] PUT /identity/v3/projects/3db704d8162849e69dd833963a006a2a/users/cb7e30c5b64247c79a373b66c79f343d/roles/284c6314b4d3492085e397a87b0e3b51 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 17:16:10.872768 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa144eea-bc4a-4ea5-9271-74aaee3e2624 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:16:10.942935 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:16:10.962607 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa144eea-bc4a-4ea5-9271-74aaee3e2624 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:16:11.037396 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eb29db-7f50-4d28-bf60-f4d0428a3f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '602fa21468b24207a8f98e92cd2c99ce', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:16:11.038817 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eb29db-7f50-4d28-bf60-f4d0428a3f2e admin admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:16:11.038817 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eb29db-7f50-4d28-bf60-f4d0428a3f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:16:11.039105 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eb29db-7f50-4d28-bf60-f4d0428a3f2e admin admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:16:11.039995 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3eb29db-7f50-4d28-bf60-f4d0428a3f2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:16:11.042923 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3eb29db-7f50-4d28-bf60-f4d0428a3f2e admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:16:11.065298 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 589/1189] 10.222.0.136 () {58 vars in 1126 bytes} [Thu Jul 14 17:16:10 2022] GET /identity/v3/roles => generated 1427 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 17:16:11.069702 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8498fd8c-f0d3-4f18-88d3-bfcc26a94374 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:16:11.092485 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8498fd8c-f0d3-4f18-88d3-bfcc26a94374 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:16:11.099224 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273b6ea3-9acf-4f50-af2a-05c41fdbba49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '602fa21468b24207a8f98e92cd2c99ce', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:16:11.100207 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273b6ea3-9acf-4f50-af2a-05c41fdbba49 admin admin] REQUEST_METHOD: `PUT` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:16:11.100492 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273b6ea3-9acf-4f50-af2a-05c41fdbba49 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:16:11.100766 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273b6ea3-9acf-4f50-af2a-05c41fdbba49 admin admin] PATH_INFO: `/v3/projects/3db704d8162849e69dd833963a006a2a/users/cb7e30c5b64247c79a373b66c79f343d/roles/284c6314b4d3492085e397a87b0e3b51` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:16:11.103229 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273b6ea3-9acf-4f50-af2a-05c41fdbba49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3db704d8162849e69dd833963a006a2a, user_id=cb7e30c5b64247c79a373b66c79f343d, role_id=284c6314b4d3492085e397a87b0e3b51)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:16:11.107532 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273b6ea3-9acf-4f50-af2a-05c41fdbba49 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:16:11.129400 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 601/1190] 10.222.0.136 () {60 vars in 1487 bytes} [Thu Jul 14 17:16:11 2022] PUT /identity/v3/projects/3db704d8162849e69dd833963a006a2a/users/cb7e30c5b64247c79a373b66c79f343d/roles/284c6314b4d3492085e397a87b0e3b51 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 17:16:17.494379 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2d2d04-d327-4315-a3ea-23f392d251be None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:16:17.495027 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2d2d04-d327-4315-a3ea-23f392d251be None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:16:17.495027 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2d2d04-d327-4315-a3ea-23f392d251be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:16:17.553150 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-de2d2d04-d327-4315-a3ea-23f392d251be None None] MFA Rules not processed for user `4fb471ce708f45a7ad6cf36902ff6cf1`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:16:17.555249 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-de2d2d04-d327-4315-a3ea-23f392d251be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:16:17.759684 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 590/1191] 10.222.0.136 () {58 vars in 962 bytes} [Thu Jul 14 17:16:17 2022] POST /identity/v3/auth/tokens => generated 2879 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:16:17.780425 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273b6ea3-9acf-4f50-af2a-05c41fdbba49 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:16:17.782503 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-273b6ea3-9acf-4f50-af2a-05c41fdbba49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:16:17.861740 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:16:17.919109 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273b6ea3-9acf-4f50-af2a-05c41fdbba49 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:16:17.926793 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9961605-6726-41f2-bfdc-cac27b326c53 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c3d46d376c460a99426a5dc7c66115', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd57eaa6dbca24cbb99dce1fe3437ecae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:16:17.927474 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9961605-6726-41f2-bfdc-cac27b326c53 service glance] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:16:17.928424 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9961605-6726-41f2-bfdc-cac27b326c53 service glance] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:16:17.928424 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9961605-6726-41f2-bfdc-cac27b326c53 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:16:18.051714 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9961605-6726-41f2-bfdc-cac27b326c53 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:16:18.053754 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9961605-6726-41f2-bfdc-cac27b326c53 service glance] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:16:18.066851 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 602/1192] 10.222.0.136 () {60 vars in 1370 bytes} [Thu Jul 14 17:16:17 2022] GET /identity/v3/auth/tokens => generated 2814 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:16:18.069783 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8b3364-8c8d-49f2-abe8-307b8a69d6e4 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:16:18.071320 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8b3364-8c8d-49f2-abe8-307b8a69d6e4 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:16:18.071712 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8b3364-8c8d-49f2-abe8-307b8a69d6e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:16:18.119800 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-da8b3364-8c8d-49f2-abe8-307b8a69d6e4 None None] MFA Rules not processed for user `cb7e30c5b64247c79a373b66c79f343d`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:16:18.121033 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-da8b3364-8c8d-49f2-abe8-307b8a69d6e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:16:18.240868 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 591/1193] 10.222.0.136 () {58 vars in 962 bytes} [Thu Jul 14 17:16:18 2022] POST /identity/v3/auth/tokens => generated 2885 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:16:18.259241 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9961605-6726-41f2-bfdc-cac27b326c53 service glance] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:16:18.260901 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-c9961605-6726-41f2-bfdc-cac27b326c53 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:16:18.275761 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9961605-6726-41f2-bfdc-cac27b326c53 service glance] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:16:18.280023 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bed66ab-cad8-498b-b8c0-f509e079d816 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c3d46d376c460a99426a5dc7c66115', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd57eaa6dbca24cbb99dce1fe3437ecae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:16:18.280922 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bed66ab-cad8-498b-b8c0-f509e079d816 service glance] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:16:18.281325 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bed66ab-cad8-498b-b8c0-f509e079d816 service glance] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:16:18.283645 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bed66ab-cad8-498b-b8c0-f509e079d816 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:16:18.383303 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bed66ab-cad8-498b-b8c0-f509e079d816 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:16:18.387695 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bed66ab-cad8-498b-b8c0-f509e079d816 service glance] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:16:18.400458 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 603/1194] 10.222.0.136 () {60 vars in 1370 bytes} [Thu Jul 14 17:16:18 2022] GET /identity/v3/auth/tokens => generated 2814 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:16:27.327560 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc3c936-ab2f-42dd-91bf-83d77013cf6c None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:16:27.328140 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc3c936-ab2f-42dd-91bf-83d77013cf6c None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:16:27.328140 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc3c936-ab2f-42dd-91bf-83d77013cf6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:16:27.336558 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:16:27.350749 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-5cc3c936-ab2f-42dd-91bf-83d77013cf6c None None] MFA Rules not processed for user `ad993fdaa8f344d4819c9abca449f144`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:16:27.352809 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-5cc3c936-ab2f-42dd-91bf-83d77013cf6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:16:27.366121 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 592/1195] 10.222.0.136 () {58 vars in 962 bytes} [Thu Jul 14 17:16:27 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:16:27.674170 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72de2554-ee07-4a33-97da-aea576bf2532 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:16:27.674722 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72de2554-ee07-4a33-97da-aea576bf2532 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:16:27.674722 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72de2554-ee07-4a33-97da-aea576bf2532 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:16:27.676190 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 604/1196] 10.222.0.136 () {54 vars in 966 bytes} [Thu Jul 14 17:16:27 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:16:27.681674 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5cd883-7618-45fa-8b9d-48d775db7b1a None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:16:27.681977 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5cd883-7618-45fa-8b9d-48d775db7b1a None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:16:27.682262 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5cd883-7618-45fa-8b9d-48d775db7b1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:16:27.718445 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-3f5cd883-7618-45fa-8b9d-48d775db7b1a None None] MFA Rules not processed for user `bc2b7d015c2046ddacac6e682f22d0f5`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:16:27.720222 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-3f5cd883-7618-45fa-8b9d-48d775db7b1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:16:27.789728 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 593/1197] 10.222.0.136 () {58 vars in 1063 bytes} [Thu Jul 14 17:16:27 2022] POST /identity/v3/auth/tokens => generated 2861 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:16:27.795357 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa0725d-00eb-4dfd-97e5-72d6c443fa30 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:16:27.795652 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa0725d-00eb-4dfd-97e5-72d6c443fa30 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:16:27.795936 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa0725d-00eb-4dfd-97e5-72d6c443fa30 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:16:27.797948 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 605/1198] 10.222.0.136 () {54 vars in 917 bytes} [Thu Jul 14 17:16:27 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:16:27.802958 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c858fa-30b4-448a-936f-6838be338998 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:16:27.803280 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c858fa-30b4-448a-936f-6838be338998 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:16:27.803593 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c858fa-30b4-448a-936f-6838be338998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:16:27.826088 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-75c858fa-30b4-448a-936f-6838be338998 None None] MFA Rules not processed for user `bc2b7d015c2046ddacac6e682f22d0f5`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:16:27.827229 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-75c858fa-30b4-448a-936f-6838be338998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:16:27.837486 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 594/1199] 10.222.0.136 () {58 vars in 1014 bytes} [Thu Jul 14 17:16:27 2022] POST /identity/v3/auth/tokens => generated 2861 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:16:27.849820 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa0725d-00eb-4dfd-97e5-72d6c443fa30 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:16:27.861949 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa0725d-00eb-4dfd-97e5-72d6c443fa30 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:16:27.865796 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4b8657-4dd9-4a20-9d02-b13dd43e0289 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c3d46d376c460a99426a5dc7c66115', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd57eaa6dbca24cbb99dce1fe3437ecae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:16:27.866303 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4b8657-4dd9-4a20-9d02-b13dd43e0289 service glance] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:16:27.866587 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4b8657-4dd9-4a20-9d02-b13dd43e0289 service glance] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:16:27.866873 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4b8657-4dd9-4a20-9d02-b13dd43e0289 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:16:27.877296 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4b8657-4dd9-4a20-9d02-b13dd43e0289 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:16:27.878873 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4b8657-4dd9-4a20-9d02-b13dd43e0289 service glance] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:16:27.890030 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 606/1200] 10.222.0.136 () {60 vars in 1370 bytes} [Thu Jul 14 17:16:27 2022] GET /identity/v3/auth/tokens => generated 2861 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:16:28.279001 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cb9ab7-dc32-49aa-b826-ac72bc0fcbc5 None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:16:28.279309 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cb9ab7-dc32-49aa-b826-ac72bc0fcbc5 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:16:28.280012 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cb9ab7-dc32-49aa-b826-ac72bc0fcbc5 None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:16:28.281154 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 595/1201] 10.222.0.136 () {54 vars in 917 bytes} [Thu Jul 14 17:16:28 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:16:28.292181 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a39cbf1-f1c2-4c5a-818b-721cdfbce735 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:16:28.292476 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a39cbf1-f1c2-4c5a-818b-721cdfbce735 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:16:28.292755 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a39cbf1-f1c2-4c5a-818b-721cdfbce735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:16:28.311998 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-9a39cbf1-f1c2-4c5a-818b-721cdfbce735 None None] MFA Rules not processed for user `a8c6871e11f047e284afdb16bcb1d3a4`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:16:28.313260 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-9a39cbf1-f1c2-4c5a-818b-721cdfbce735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:16:28.388935 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 607/1202] 10.222.0.136 () {58 vars in 1014 bytes} [Thu Jul 14 17:16:28 2022] POST /identity/v3/auth/tokens => generated 2679 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:16:28.402385 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cb9ab7-dc32-49aa-b826-ac72bc0fcbc5 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:16:28.422910 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cb9ab7-dc32-49aa-b826-ac72bc0fcbc5 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:16:28.428345 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5a5fa3-0e7d-4480-a539-1a22c1294020 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8c6871e11f047e284afdb16bcb1d3a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd57eaa6dbca24cbb99dce1fe3437ecae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:16:28.438098 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5a5fa3-0e7d-4480-a539-1a22c1294020 service neutron] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:16:28.438404 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5a5fa3-0e7d-4480-a539-1a22c1294020 service neutron] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:16:28.438904 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5a5fa3-0e7d-4480-a539-1a22c1294020 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:16:28.449010 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5a5fa3-0e7d-4480-a539-1a22c1294020 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:16:28.451232 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5a5fa3-0e7d-4480-a539-1a22c1294020 service neutron] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:16:28.470094 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 596/1203] 10.222.0.136 () {60 vars in 1370 bytes} [Thu Jul 14 17:16:28 2022] GET /identity/v3/auth/tokens => generated 2679 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:16:28.956718 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9894a3b8-8fc3-438e-aedf-cb407b0325fc None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:16:28.957676 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9894a3b8-8fc3-438e-aedf-cb407b0325fc None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:16:28.957676 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9894a3b8-8fc3-438e-aedf-cb407b0325fc None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:16:28.958666 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 608/1204] 10.222.0.136 () {54 vars in 966 bytes} [Thu Jul 14 17:16:28 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:16:28.975406 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc94a34-9800-4eb3-95d5-6b937fc865ef None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:16:28.976010 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc94a34-9800-4eb3-95d5-6b937fc865ef None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:16:28.977704 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e350377b-947f-4521-a82d-50d2e37470b2 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:16:28.978323 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e350377b-947f-4521-a82d-50d2e37470b2 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:16:28.978934 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e350377b-947f-4521-a82d-50d2e37470b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:16:28.979701 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc94a34-9800-4eb3-95d5-6b937fc865ef None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:16:28.981579 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 597/1205] 10.222.0.136 () {54 vars in 965 bytes} [Thu Jul 14 17:16:28 2022] GET /identity => generated 271 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:16:28.988023 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d12ee11-9989-4b24-ad90-f9921fd43e13 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:16:28.988360 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d12ee11-9989-4b24-ad90-f9921fd43e13 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:16:28.988582 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d12ee11-9989-4b24-ad90-f9921fd43e13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:16:29.014134 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-3d12ee11-9989-4b24-ad90-f9921fd43e13 None None] MFA Rules not processed for user `05cdf81bd7d14730962816677457e858`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:16:29.014735 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-e350377b-947f-4521-a82d-50d2e37470b2 None None] MFA Rules not processed for user `bc2b7d015c2046ddacac6e682f22d0f5`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:16:29.015349 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-3d12ee11-9989-4b24-ad90-f9921fd43e13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:16:29.017665 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-e350377b-947f-4521-a82d-50d2e37470b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:16:29.033109 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 609/1206] 10.222.0.136 () {58 vars in 1063 bytes} [Thu Jul 14 17:16:28 2022] POST /identity/v3/auth/tokens => generated 2861 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:16:29.039876 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745448d5-ab8c-42ee-9f92-c435c6004674 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:16:29.040389 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745448d5-ab8c-42ee-9f92-c435c6004674 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:16:29.040852 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745448d5-ab8c-42ee-9f92-c435c6004674 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:16:29.046606 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 610/1207] 10.222.0.136 () {54 vars in 917 bytes} [Thu Jul 14 17:16:29 2022] GET /identity => generated 271 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 14 17:16:29.049036 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ffb647-8824-4c99-a102-d474ba37e8e2 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:16:29.049533 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ffb647-8824-4c99-a102-d474ba37e8e2 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:16:29.050019 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ffb647-8824-4c99-a102-d474ba37e8e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:16:29.076974 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-08ffb647-8824-4c99-a102-d474ba37e8e2 None None] MFA Rules not processed for user `bc2b7d015c2046ddacac6e682f22d0f5`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:16:29.080296 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-08ffb647-8824-4c99-a102-d474ba37e8e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:16:29.090959 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 611/1208] 10.222.0.136 () {58 vars in 1014 bytes} [Thu Jul 14 17:16:29 2022] POST /identity/v3/auth/tokens => generated 2861 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:16:29.104934 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ffb647-8824-4c99-a102-d474ba37e8e2 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:16:29.105143 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 598/1209] 10.222.0.136 () {58 vars in 1062 bytes} [Thu Jul 14 17:16:28 2022] POST /identity/v3/auth/tokens => generated 2866 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:16:29.112797 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d12ee11-9989-4b24-ad90-f9921fd43e13 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:16:29.121512 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ffb647-8824-4c99-a102-d474ba37e8e2 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:16:29.123613 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d12ee11-9989-4b24-ad90-f9921fd43e13 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:16:29.126710 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dff7ce-1da8-4eb8-9d4d-2ab843d42f5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8c6871e11f047e284afdb16bcb1d3a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd57eaa6dbca24cbb99dce1fe3437ecae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:16:29.127535 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dff7ce-1da8-4eb8-9d4d-2ab843d42f5e service neutron] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:16:29.127865 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dff7ce-1da8-4eb8-9d4d-2ab843d42f5e service neutron] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:16:29.128745 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dff7ce-1da8-4eb8-9d4d-2ab843d42f5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:16:29.130229 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0500077f-2756-4b55-bfe2-4f8e9f74aa10 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05cdf81bd7d14730962816677457e858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd57eaa6dbca24cbb99dce1fe3437ecae', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:16:29.130899 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0500077f-2756-4b55-bfe2-4f8e9f74aa10 service placement] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:16:29.131194 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0500077f-2756-4b55-bfe2-4f8e9f74aa10 service placement] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:16:29.131485 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0500077f-2756-4b55-bfe2-4f8e9f74aa10 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:16:29.135194 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-0500077f-2756-4b55-bfe2-4f8e9f74aa10 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:16:29.135954 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:16:29.143268 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dff7ce-1da8-4eb8-9d4d-2ab843d42f5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:16:29.144933 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dff7ce-1da8-4eb8-9d4d-2ab843d42f5e service neutron] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:16:29.153120 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0500077f-2756-4b55-bfe2-4f8e9f74aa10 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:16:29.156529 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0500077f-2756-4b55-bfe2-4f8e9f74aa10 service placement] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:16:29.158692 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 612/1210] 10.222.0.136 () {60 vars in 1370 bytes} [Thu Jul 14 17:16:29 2022] GET /identity/v3/auth/tokens => generated 2861 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 17:16:29.169700 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 599/1211] 10.222.0.136 () {60 vars in 1370 bytes} [Thu Jul 14 17:16:29 2022] GET /identity/v3/auth/tokens => generated 2866 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 17:16:39.115776 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be288223-3181-44b5-8acb-444383c62d78 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:16:39.116375 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be288223-3181-44b5-8acb-444383c62d78 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:16:39.116375 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be288223-3181-44b5-8acb-444383c62d78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:16:39.134439 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-be288223-3181-44b5-8acb-444383c62d78 None None] MFA Rules not processed for user `a8c6871e11f047e284afdb16bcb1d3a4`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:16:39.135637 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-be288223-3181-44b5-8acb-444383c62d78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:16:39.142571 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 613/1212] 10.222.0.107 () {58 vars in 1020 bytes} [Thu Jul 14 17:16:39 2022] POST /identity/v3/auth/tokens => generated 2679 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 17:16:39.154092 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0500077f-2756-4b55-bfe2-4f8e9f74aa10 service placement] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:16:39.163256 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0500077f-2756-4b55-bfe2-4f8e9f74aa10 service placement] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:16:39.166990 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89427d87-89f0-43c2-8a1b-75cdecdce701 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8c6871e11f047e284afdb16bcb1d3a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd57eaa6dbca24cbb99dce1fe3437ecae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:16:39.167672 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89427d87-89f0-43c2-8a1b-75cdecdce701 service neutron] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:16:39.167960 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89427d87-89f0-43c2-8a1b-75cdecdce701 service neutron] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:16:39.168241 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89427d87-89f0-43c2-8a1b-75cdecdce701 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:16:39.175816 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89427d87-89f0-43c2-8a1b-75cdecdce701 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:16:39.177840 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89427d87-89f0-43c2-8a1b-75cdecdce701 service neutron] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:16:39.185772 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 600/1213] 10.222.0.136 () {60 vars in 1370 bytes} [Thu Jul 14 17:16:39 2022] GET /identity/v3/auth/tokens => generated 2679 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 17:16:40.114232 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087302cb-f862-42a5-a58e-87ef32ddfa01 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:16:40.114801 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087302cb-f862-42a5-a58e-87ef32ddfa01 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:16:40.115205 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087302cb-f862-42a5-a58e-87ef32ddfa01 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:16:40.117190 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 614/1214] 10.222.0.136 () {54 vars in 926 bytes} [Thu Jul 14 17:16:40 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:16:40.164097 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08be3042-f27e-4a6b-8642-2d7ee19254bb None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:16:40.164097 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08be3042-f27e-4a6b-8642-2d7ee19254bb None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:16:40.164097 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08be3042-f27e-4a6b-8642-2d7ee19254bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:16:40.194293 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-08be3042-f27e-4a6b-8642-2d7ee19254bb None None] MFA Rules not processed for user `bc2b7d015c2046ddacac6e682f22d0f5`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:16:40.195994 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-08be3042-f27e-4a6b-8642-2d7ee19254bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:16:40.209133 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 601/1215] 10.222.0.136 () {58 vars in 1023 bytes} [Thu Jul 14 17:16:40 2022] POST /identity/v3/auth/tokens => generated 2861 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:16:40.233112 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087302cb-f862-42a5-a58e-87ef32ddfa01 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:16:40.248671 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087302cb-f862-42a5-a58e-87ef32ddfa01 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:16:40.256317 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9631be4-b743-4168-8c64-c5bc00664868 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc2b7d015c2046ddacac6e682f22d0f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd57eaa6dbca24cbb99dce1fe3437ecae', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:16:40.257433 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9631be4-b743-4168-8c64-c5bc00664868 service nova] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:16:40.257802 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9631be4-b743-4168-8c64-c5bc00664868 service nova] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:16:40.258326 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9631be4-b743-4168-8c64-c5bc00664868 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:16:40.272448 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9631be4-b743-4168-8c64-c5bc00664868 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:16:40.274571 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9631be4-b743-4168-8c64-c5bc00664868 service nova] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:16:40.287677 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 615/1216] 10.222.0.136 () {60 vars in 1370 bytes} [Thu Jul 14 17:16:40 2022] GET /identity/v3/auth/tokens => generated 2861 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:16:46.921238 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e592292-7eb6-48f3-9473-c94e5bdb76eb None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:16:46.922530 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e592292-7eb6-48f3-9473-c94e5bdb76eb None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:16:46.922530 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e592292-7eb6-48f3-9473-c94e5bdb76eb None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:16:46.923892 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 602/1217] 10.222.0.136 () {54 vars in 926 bytes} [Thu Jul 14 17:16:46 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:16:46.935452 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c905fdde-7a23-46e3-b2e1-f544b7cea9c4 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:16:46.936185 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c905fdde-7a23-46e3-b2e1-f544b7cea9c4 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:16:46.936185 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c905fdde-7a23-46e3-b2e1-f544b7cea9c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:16:46.959577 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-c905fdde-7a23-46e3-b2e1-f544b7cea9c4 None None] MFA Rules not processed for user `bc2b7d015c2046ddacac6e682f22d0f5`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:16:46.960722 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-c905fdde-7a23-46e3-b2e1-f544b7cea9c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:16:46.971638 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 616/1218] 10.222.0.136 () {58 vars in 1023 bytes} [Thu Jul 14 17:16:46 2022] POST /identity/v3/auth/tokens => generated 2861 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:16:47.083365 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e592292-7eb6-48f3-9473-c94e5bdb76eb None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:16:47.097633 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e592292-7eb6-48f3-9473-c94e5bdb76eb None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:16:47.106685 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f110e9e0-2781-4e87-adf7-f78526edbbb2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc2b7d015c2046ddacac6e682f22d0f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd57eaa6dbca24cbb99dce1fe3437ecae', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:16:47.107368 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f110e9e0-2781-4e87-adf7-f78526edbbb2 service nova] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:16:47.107658 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f110e9e0-2781-4e87-adf7-f78526edbbb2 service nova] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:16:47.107941 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f110e9e0-2781-4e87-adf7-f78526edbbb2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:16:47.118354 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f110e9e0-2781-4e87-adf7-f78526edbbb2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:16:47.119975 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f110e9e0-2781-4e87-adf7-f78526edbbb2 service nova] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:16:47.130971 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 603/1219] 10.222.0.136 () {60 vars in 1370 bytes} [Thu Jul 14 17:16:47 2022] GET /identity/v3/auth/tokens => generated 2861 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:16:56.951915 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=15 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:16:57.126711 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=94 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:16:58.372915 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c905fdde-7a23-46e3-b2e1-f544b7cea9c4 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:16:58.382794 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c905fdde-7a23-46e3-b2e1-f544b7cea9c4 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:16:58.386591 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d252dd-819a-4616-81df-647e0f2dd1e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8c6871e11f047e284afdb16bcb1d3a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd57eaa6dbca24cbb99dce1fe3437ecae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:16:58.387249 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d252dd-819a-4616-81df-647e0f2dd1e3 service neutron] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:16:58.387544 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d252dd-819a-4616-81df-647e0f2dd1e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:16:58.387829 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d252dd-819a-4616-81df-647e0f2dd1e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:16:58.398240 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d252dd-819a-4616-81df-647e0f2dd1e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:16:58.399668 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d252dd-819a-4616-81df-647e0f2dd1e3 service neutron] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:16:58.410022 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 617/1220] 10.222.0.136 () {60 vars in 1370 bytes} [Thu Jul 14 17:16:58 2022] GET /identity/v3/auth/tokens => generated 2885 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:17:08.404979 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=6 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:17:18.292921 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fbe68b-23f3-4867-afa1-8bfbb9410397 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:17:18.293497 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fbe68b-23f3-4867-afa1-8bfbb9410397 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:17:18.293497 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fbe68b-23f3-4867-afa1-8bfbb9410397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:17:18.311192 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-b4fbe68b-23f3-4867-afa1-8bfbb9410397 None None] MFA Rules not processed for user `6129f495e1214cc9b7cb922096858c34`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:17:18.312404 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-b4fbe68b-23f3-4867-afa1-8bfbb9410397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:17:18.320056 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 604/1221] 10.222.0.136 () {58 vars in 962 bytes} [Thu Jul 14 17:17:18 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:17:18.689297 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2239729-24cb-4fe2-98f2-82076b1fba64 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:17:18.689889 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2239729-24cb-4fe2-98f2-82076b1fba64 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:17:18.690011 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2239729-24cb-4fe2-98f2-82076b1fba64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:17:18.707740 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-d2239729-24cb-4fe2-98f2-82076b1fba64 None None] MFA Rules not processed for user `a8c6871e11f047e284afdb16bcb1d3a4`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:17:18.709826 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-d2239729-24cb-4fe2-98f2-82076b1fba64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:17:18.716462 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 618/1222] 10.222.0.136 () {58 vars in 1014 bytes} [Thu Jul 14 17:17:18 2022] POST /identity/v3/auth/tokens => generated 2679 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:17:18.728640 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fbe68b-23f3-4867-afa1-8bfbb9410397 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:17:18.738343 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fbe68b-23f3-4867-afa1-8bfbb9410397 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:17:18.741978 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13188a5-4bd8-466b-84a4-3e8397dcb828 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8c6871e11f047e284afdb16bcb1d3a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd57eaa6dbca24cbb99dce1fe3437ecae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:17:18.742619 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13188a5-4bd8-466b-84a4-3e8397dcb828 service neutron] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:17:18.742904 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13188a5-4bd8-466b-84a4-3e8397dcb828 service neutron] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:17:18.743180 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13188a5-4bd8-466b-84a4-3e8397dcb828 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:17:18.750278 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13188a5-4bd8-466b-84a4-3e8397dcb828 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:17:18.751701 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13188a5-4bd8-466b-84a4-3e8397dcb828 service neutron] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:17:18.760862 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 605/1223] 10.222.0.136 () {60 vars in 1370 bytes} [Thu Jul 14 17:17:18 2022] GET /identity/v3/auth/tokens => generated 2679 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:17:28.702774 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=3 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:17:28.757606 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=9 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:17:37.740169 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528e9245-8c85-4734-af62-034c9c2d9b33 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:17:37.740658 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528e9245-8c85-4734-af62-034c9c2d9b33 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:17:37.740960 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528e9245-8c85-4734-af62-034c9c2d9b33 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:17:37.742471 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 619/1224] 10.222.0.136 () {54 vars in 926 bytes} [Thu Jul 14 17:17:37 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:17:37.748068 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ee475c-ea96-40ce-8124-7c874dddac88 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:17:37.748490 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ee475c-ea96-40ce-8124-7c874dddac88 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:17:37.748652 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ee475c-ea96-40ce-8124-7c874dddac88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:17:37.768109 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-22ee475c-ea96-40ce-8124-7c874dddac88 None None] MFA Rules not processed for user `bc2b7d015c2046ddacac6e682f22d0f5`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:17:37.769368 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-22ee475c-ea96-40ce-8124-7c874dddac88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:17:37.778739 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 606/1225] 10.222.0.136 () {58 vars in 1023 bytes} [Thu Jul 14 17:17:37 2022] POST /identity/v3/auth/tokens => generated 2861 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:17:37.795268 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528e9245-8c85-4734-af62-034c9c2d9b33 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:17:37.809520 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528e9245-8c85-4734-af62-034c9c2d9b33 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:17:37.814648 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ed5523-b1dc-4c9e-8cfa-0951412413f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc2b7d015c2046ddacac6e682f22d0f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd57eaa6dbca24cbb99dce1fe3437ecae', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:17:37.815285 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ed5523-b1dc-4c9e-8cfa-0951412413f0 service nova] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:17:37.815567 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ed5523-b1dc-4c9e-8cfa-0951412413f0 service nova] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:17:37.815842 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ed5523-b1dc-4c9e-8cfa-0951412413f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:17:37.825329 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ed5523-b1dc-4c9e-8cfa-0951412413f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:17:37.827011 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ed5523-b1dc-4c9e-8cfa-0951412413f0 service nova] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:17:37.837309 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 620/1226] 10.222.0.136 () {60 vars in 1370 bytes} [Thu Jul 14 17:17:37 2022] GET /identity/v3/auth/tokens => generated 2861 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 17:17:43.714197 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9745bff8-5418-4b7a-b586-a73a1e6461a5 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:17:43.714697 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9745bff8-5418-4b7a-b586-a73a1e6461a5 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:17:43.714782 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9745bff8-5418-4b7a-b586-a73a1e6461a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:17:43.732508 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-9745bff8-5418-4b7a-b586-a73a1e6461a5 None None] MFA Rules not processed for user `6129f495e1214cc9b7cb922096858c34`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:17:43.733745 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-9745bff8-5418-4b7a-b586-a73a1e6461a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:17:43.740512 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 607/1227] 10.222.0.136 () {58 vars in 962 bytes} [Thu Jul 14 17:17:43 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:17:47.833086 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=6 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:17:53.726852 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=6 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:17:57.204119 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1821cba2-3691-46bc-9714-84fa774b4b39 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:17:57.204619 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1821cba2-3691-46bc-9714-84fa774b4b39 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:17:57.204722 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1821cba2-3691-46bc-9714-84fa774b4b39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:17:57.223388 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-1821cba2-3691-46bc-9714-84fa774b4b39 None None] MFA Rules not processed for user `6129f495e1214cc9b7cb922096858c34`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:17:57.224589 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-1821cba2-3691-46bc-9714-84fa774b4b39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:17:57.232502 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 621/1228] 10.222.0.136 () {58 vars in 962 bytes} [Thu Jul 14 17:17:57 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:18:07.218402 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=3 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:18:55.511160 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c5bbcb-3fb7-4cf2-b4b5-2e26d447079d None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:18:55.511661 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c5bbcb-3fb7-4cf2-b4b5-2e26d447079d None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:18:55.511749 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c5bbcb-3fb7-4cf2-b4b5-2e26d447079d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:18:55.529069 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-e5c5bbcb-3fb7-4cf2-b4b5-2e26d447079d None None] MFA Rules not processed for user `6129f495e1214cc9b7cb922096858c34`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:18:55.531038 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-e5c5bbcb-3fb7-4cf2-b4b5-2e26d447079d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:18:55.538009 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 608/1229] 10.222.0.136 () {58 vars in 962 bytes} [Thu Jul 14 17:18:55 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 17:19:05.523910 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=3 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:19:08.267643 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1821cba2-3691-46bc-9714-84fa774b4b39 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:19:08.288006 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1821cba2-3691-46bc-9714-84fa774b4b39 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:19:08.291592 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9483cf-fe71-4210-a793-cf95fa6364f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8c6871e11f047e284afdb16bcb1d3a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd57eaa6dbca24cbb99dce1fe3437ecae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:19:08.292230 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9483cf-fe71-4210-a793-cf95fa6364f7 service neutron] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:19:08.292517 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9483cf-fe71-4210-a793-cf95fa6364f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:19:08.292799 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9483cf-fe71-4210-a793-cf95fa6364f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:19:08.302437 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9483cf-fe71-4210-a793-cf95fa6364f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:19:08.303864 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9483cf-fe71-4210-a793-cf95fa6364f7 service neutron] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:19:08.314205 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 622/1230] 10.222.0.136 () {60 vars in 1370 bytes} [Thu Jul 14 17:19:08 2022] GET /identity/v3/auth/tokens => generated 2879 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:19:18.309152 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=10 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:20:22.929266 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c5bbcb-3fb7-4cf2-b4b5-2e26d447079d None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:20:22.954974 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c5bbcb-3fb7-4cf2-b4b5-2e26d447079d None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:20:22.961019 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbf32ec-efe3-4645-8fbe-aaa04ff7cc35 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05cdf81bd7d14730962816677457e858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd57eaa6dbca24cbb99dce1fe3437ecae', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:20:22.961750 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbf32ec-efe3-4645-8fbe-aaa04ff7cc35 service placement] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:20:22.962049 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbf32ec-efe3-4645-8fbe-aaa04ff7cc35 service placement] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:20:22.962327 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbf32ec-efe3-4645-8fbe-aaa04ff7cc35 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:20:22.971046 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbf32ec-efe3-4645-8fbe-aaa04ff7cc35 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:20:22.972681 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbf32ec-efe3-4645-8fbe-aaa04ff7cc35 service placement] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:20:22.983766 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 609/1231] 10.222.0.136 () {60 vars in 1370 bytes} [Thu Jul 14 17:20:22 2022] GET /identity/v3/auth/tokens => generated 2866 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:20:32.979511 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=10 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:20:49.816929 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3c50de-2122-4e41-8815-0feb4147828b None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:20:49.817434 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3c50de-2122-4e41-8815-0feb4147828b None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:20:49.817536 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3c50de-2122-4e41-8815-0feb4147828b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:20:49.835982 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-9f3c50de-2122-4e41-8815-0feb4147828b None None] MFA Rules not processed for user `ad993fdaa8f344d4819c9abca449f144`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:20:49.837166 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-9f3c50de-2122-4e41-8815-0feb4147828b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:20:49.844073 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 623/1232] 10.222.0.136 () {58 vars in 962 bytes} [Thu Jul 14 17:20:49 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:20:59.831343 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=3 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:21:18.408341 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbf32ec-efe3-4645-8fbe-aaa04ff7cc35 service placement] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:21:18.433315 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbf32ec-efe3-4645-8fbe-aaa04ff7cc35 service placement] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:21:18.438890 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9994e16f-3e9d-4d3e-946c-4d264a6f3f07 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc2b7d015c2046ddacac6e682f22d0f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd57eaa6dbca24cbb99dce1fe3437ecae', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:21:18.439642 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9994e16f-3e9d-4d3e-946c-4d264a6f3f07 service nova] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:21:18.439938 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9994e16f-3e9d-4d3e-946c-4d264a6f3f07 service nova] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:21:18.440222 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9994e16f-3e9d-4d3e-946c-4d264a6f3f07 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:21:18.448827 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9994e16f-3e9d-4d3e-946c-4d264a6f3f07 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:21:18.450757 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9994e16f-3e9d-4d3e-946c-4d264a6f3f07 service nova] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:21:18.461298 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 610/1233] 10.222.0.136 () {60 vars in 1370 bytes} [Thu Jul 14 17:21:18 2022] GET /identity/v3/auth/tokens => generated 2814 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:21:19.620443 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a908bc9-b2b3-4a57-ae71-8d93366fa490 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:21:19.621014 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a908bc9-b2b3-4a57-ae71-8d93366fa490 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:21:19.621104 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a908bc9-b2b3-4a57-ae71-8d93366fa490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:21:19.639950 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-7a908bc9-b2b3-4a57-ae71-8d93366fa490 None None] MFA Rules not processed for user `6129f495e1214cc9b7cb922096858c34`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:21:19.641215 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-7a908bc9-b2b3-4a57-ae71-8d93366fa490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:21:19.648253 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 624/1234] 10.222.0.136 () {58 vars in 962 bytes} [Thu Jul 14 17:21:19 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:21:28.457746 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=10 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:21:29.634550 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=3 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:21:29.754471 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9994e16f-3e9d-4d3e-946c-4d264a6f3f07 service nova] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:21:29.764142 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9994e16f-3e9d-4d3e-946c-4d264a6f3f07 service nova] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:21:29.767872 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1611659d-e3cc-4c56-b18b-19f7df6c71fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8c6871e11f047e284afdb16bcb1d3a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd57eaa6dbca24cbb99dce1fe3437ecae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:21:29.768620 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1611659d-e3cc-4c56-b18b-19f7df6c71fe service neutron] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:21:29.768975 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1611659d-e3cc-4c56-b18b-19f7df6c71fe service neutron] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:21:29.769325 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1611659d-e3cc-4c56-b18b-19f7df6c71fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:21:29.779594 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1611659d-e3cc-4c56-b18b-19f7df6c71fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:21:29.781948 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1611659d-e3cc-4c56-b18b-19f7df6c71fe service neutron] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:21:29.793337 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 611/1235] 10.222.0.136 () {60 vars in 1370 bytes} [Thu Jul 14 17:21:29 2022] GET /identity/v3/auth/tokens => generated 2861 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:21:30.971765 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a908bc9-b2b3-4a57-ae71-8d93366fa490 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:21:30.981477 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a908bc9-b2b3-4a57-ae71-8d93366fa490 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:21:30.985616 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa7eaf4-99f9-4016-b06d-8f93b7186d0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8c6871e11f047e284afdb16bcb1d3a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd57eaa6dbca24cbb99dce1fe3437ecae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:21:30.986256 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa7eaf4-99f9-4016-b06d-8f93b7186d0b service neutron] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:21:30.986540 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa7eaf4-99f9-4016-b06d-8f93b7186d0b service neutron] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:21:30.986818 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa7eaf4-99f9-4016-b06d-8f93b7186d0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:21:30.996353 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa7eaf4-99f9-4016-b06d-8f93b7186d0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:21:30.997799 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa7eaf4-99f9-4016-b06d-8f93b7186d0b service neutron] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:21:31.008813 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 625/1236] 10.222.0.136 () {60 vars in 1370 bytes} [Thu Jul 14 17:21:30 2022] GET /identity/v3/auth/tokens => generated 2861 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:21:39.788472 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=6 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:21:41.004349 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=6 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:21:42.713597 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1611659d-e3cc-4c56-b18b-19f7df6c71fe service neutron] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:21:42.724699 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1611659d-e3cc-4c56-b18b-19f7df6c71fe service neutron] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:21:42.730060 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983ada15-f8fd-438d-9dd8-6eb9e72f6292 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc2b7d015c2046ddacac6e682f22d0f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd57eaa6dbca24cbb99dce1fe3437ecae', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:21:42.730704 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983ada15-f8fd-438d-9dd8-6eb9e72f6292 service nova] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:21:42.730996 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983ada15-f8fd-438d-9dd8-6eb9e72f6292 service nova] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:21:42.731278 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983ada15-f8fd-438d-9dd8-6eb9e72f6292 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:21:42.739687 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983ada15-f8fd-438d-9dd8-6eb9e72f6292 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:21:42.741271 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983ada15-f8fd-438d-9dd8-6eb9e72f6292 service nova] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:21:42.750629 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 612/1237] 10.222.0.136 () {60 vars in 1370 bytes} [Thu Jul 14 17:21:42 2022] GET /identity/v3/auth/tokens => generated 2814 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:21:42.967147 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa7eaf4-99f9-4016-b06d-8f93b7186d0b service neutron] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:21:42.977053 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa7eaf4-99f9-4016-b06d-8f93b7186d0b service neutron] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:21:42.981158 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f457e48d-18e4-42d0-9e2e-fbcb181c102b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8c6871e11f047e284afdb16bcb1d3a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd57eaa6dbca24cbb99dce1fe3437ecae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:21:42.981858 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f457e48d-18e4-42d0-9e2e-fbcb181c102b service neutron] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:21:42.982148 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f457e48d-18e4-42d0-9e2e-fbcb181c102b service neutron] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:21:42.982433 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f457e48d-18e4-42d0-9e2e-fbcb181c102b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:21:42.991628 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f457e48d-18e4-42d0-9e2e-fbcb181c102b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:21:42.993084 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f457e48d-18e4-42d0-9e2e-fbcb181c102b service neutron] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:21:43.001503 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 626/1238] 10.222.0.136 () {60 vars in 1370 bytes} [Thu Jul 14 17:21:42 2022] GET /identity/v3/auth/tokens => generated 2679 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:21:52.746307 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=6 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:21:52.997994 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=6 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:22:29.093160 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983ada15-f8fd-438d-9dd8-6eb9e72f6292 service nova] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:22:29.120332 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983ada15-f8fd-438d-9dd8-6eb9e72f6292 service nova] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:22:29.132922 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282143ec-fec8-4470-ba95-8e408485283f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc2b7d015c2046ddacac6e682f22d0f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd57eaa6dbca24cbb99dce1fe3437ecae', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:22:29.133649 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282143ec-fec8-4470-ba95-8e408485283f service nova] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:22:29.133945 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282143ec-fec8-4470-ba95-8e408485283f service nova] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:22:29.134262 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282143ec-fec8-4470-ba95-8e408485283f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:22:29.150122 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282143ec-fec8-4470-ba95-8e408485283f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:22:29.153254 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282143ec-fec8-4470-ba95-8e408485283f service nova] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:22:29.167137 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 613/1239] 10.222.0.136 () {60 vars in 1370 bytes} [Thu Jul 14 17:22:29 2022] GET /identity/v3/auth/tokens => generated 2861 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 17:22:37.248728 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f457e48d-18e4-42d0-9e2e-fbcb181c102b service neutron] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:22:37.257213 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f457e48d-18e4-42d0-9e2e-fbcb181c102b service neutron] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:22:37.260795 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2db162-bc0d-4098-a535-72c187460638 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8c6871e11f047e284afdb16bcb1d3a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd57eaa6dbca24cbb99dce1fe3437ecae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:22:37.261431 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2db162-bc0d-4098-a535-72c187460638 service neutron] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:22:37.261758 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2db162-bc0d-4098-a535-72c187460638 service neutron] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:22:37.262041 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2db162-bc0d-4098-a535-72c187460638 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:22:37.323485 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2db162-bc0d-4098-a535-72c187460638 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:22:37.324922 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2db162-bc0d-4098-a535-72c187460638 service neutron] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:22:37.343384 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 627/1240] 10.222.0.136 () {60 vars in 1370 bytes} [Thu Jul 14 17:22:37 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:22:39.161313 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=6 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:22:40.695449 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2a3112-42a9-4223-af1c-f9ab49431009 None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:22:40.696129 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2a3112-42a9-4223-af1c-f9ab49431009 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:22:40.696129 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2a3112-42a9-4223-af1c-f9ab49431009 None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:22:40.697643 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 614/1241] 10.222.0.136 () {54 vars in 926 bytes} [Thu Jul 14 17:22:40 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 17:22:40.704067 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea39e85-f910-457a-a138-7ac0f6136caf None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:22:40.704527 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea39e85-f910-457a-a138-7ac0f6136caf None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:22:40.704755 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea39e85-f910-457a-a138-7ac0f6136caf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:22:40.778967 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-aea39e85-f910-457a-a138-7ac0f6136caf None None] MFA Rules not processed for user `05cdf81bd7d14730962816677457e858`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:22:40.780118 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-aea39e85-f910-457a-a138-7ac0f6136caf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:22:40.789341 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 628/1242] 10.222.0.136 () {58 vars in 1023 bytes} [Thu Jul 14 17:22:40 2022] POST /identity/v3/auth/tokens => generated 2866 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:22:40.966467 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2a3112-42a9-4223-af1c-f9ab49431009 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:22:40.981066 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2a3112-42a9-4223-af1c-f9ab49431009 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:22:40.986800 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e864773e-2c39-44b8-b1f4-5307059212a9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05cdf81bd7d14730962816677457e858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd57eaa6dbca24cbb99dce1fe3437ecae', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:22:40.988307 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e864773e-2c39-44b8-b1f4-5307059212a9 service placement] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:22:40.988752 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e864773e-2c39-44b8-b1f4-5307059212a9 service placement] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:22:40.989198 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e864773e-2c39-44b8-b1f4-5307059212a9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:22:41.000455 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e864773e-2c39-44b8-b1f4-5307059212a9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:22:41.002137 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e864773e-2c39-44b8-b1f4-5307059212a9 service placement] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:22:41.012784 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 615/1243] 10.222.0.136 () {60 vars in 1370 bytes} [Thu Jul 14 17:22:40 2022] GET /identity/v3/auth/tokens => generated 2866 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:22:43.841625 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea39e85-f910-457a-a138-7ac0f6136caf None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:22:43.857516 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea39e85-f910-457a-a138-7ac0f6136caf None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:22:43.862726 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec41ee5-5cbc-45e4-a91c-7b343fefa3d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '602fa21468b24207a8f98e92cd2c99ce', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:22:43.863600 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec41ee5-5cbc-45e4-a91c-7b343fefa3d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:22:43.863891 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec41ee5-5cbc-45e4-a91c-7b343fefa3d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:22:43.864149 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec41ee5-5cbc-45e4-a91c-7b343fefa3d4 admin admin] PATH_INFO: `/v3/users/ad993fdaa8f344d4819c9abca449f144` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:22:43.865364 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec41ee5-5cbc-45e4-a91c-7b343fefa3d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad993fdaa8f344d4819c9abca449f144)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:22:43.866426 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: WARNING py.warnings [None req-6ec41ee5-5cbc-45e4-a91c-7b343fefa3d4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 17:22:43.866426 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: warnings.warn(msg) Jul 14 17:22:43.866426 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: Jul 14 17:22:43.867638 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec41ee5-5cbc-45e4-a91c-7b343fefa3d4 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:22:43.938932 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-6ec41ee5-5cbc-45e4-a91c-7b343fefa3d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad993fdaa8f344d4819c9abca449f144'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:22:43.951073 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-6ec41ee5-5cbc-45e4-a91c-7b343fefa3d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad993fdaa8f344d4819c9abca449f144'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:22:43.972921 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-6ec41ee5-5cbc-45e4-a91c-7b343fefa3d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad993fdaa8f344d4819c9abca449f144'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:22:43.972921 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-6ec41ee5-5cbc-45e4-a91c-7b343fefa3d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad993fdaa8f344d4819c9abca449f144'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:22:43.972921 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-6ec41ee5-5cbc-45e4-a91c-7b343fefa3d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad993fdaa8f344d4819c9abca449f144'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:22:43.986397 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 629/1244] 10.222.0.136 () {58 vars in 1228 bytes} [Thu Jul 14 17:22:43 2022] DELETE /identity/v3/users/ad993fdaa8f344d4819c9abca449f144 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:22:44.170521 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e864773e-2c39-44b8-b1f4-5307059212a9 service placement] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:22:44.182505 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e864773e-2c39-44b8-b1f4-5307059212a9 service placement] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:22:44.250716 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b4a54c-e9aa-4159-9a54-63a8751ef50e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '602fa21468b24207a8f98e92cd2c99ce', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:22:44.251544 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b4a54c-e9aa-4159-9a54-63a8751ef50e admin admin] REQUEST_METHOD: `DELETE` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:22:44.251834 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b4a54c-e9aa-4159-9a54-63a8751ef50e admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:22:44.252163 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b4a54c-e9aa-4159-9a54-63a8751ef50e admin admin] PATH_INFO: `/v3/projects/3ea1361195c1413a880c938483d78615` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:22:44.253697 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b4a54c-e9aa-4159-9a54-63a8751ef50e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ea1361195c1413a880c938483d78615)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:22:44.254726 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: WARNING py.warnings [None req-14b4a54c-e9aa-4159-9a54-63a8751ef50e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 17:22:44.254726 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: warnings.warn(msg) Jul 14 17:22:44.254726 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: Jul 14 17:22:44.255989 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b4a54c-e9aa-4159-9a54-63a8751ef50e admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:22:44.312028 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-14b4a54c-e9aa-4159-9a54-63a8751ef50e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ea1361195c1413a880c938483d78615', 'request_id': 'req-14b4a54c-e9aa-4159-9a54-63a8751ef50e'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:22:44.318749 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-14b4a54c-e9aa-4159-9a54-63a8751ef50e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ea1361195c1413a880c938483d78615', 'request_id': 'req-14b4a54c-e9aa-4159-9a54-63a8751ef50e'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:22:44.326103 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-14b4a54c-e9aa-4159-9a54-63a8751ef50e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ea1361195c1413a880c938483d78615', 'request_id': 'req-14b4a54c-e9aa-4159-9a54-63a8751ef50e'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:22:44.344829 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-14b4a54c-e9aa-4159-9a54-63a8751ef50e admin admin] The token cache is being invalidate because project 3ea1361195c1413a880c938483d78615 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98474) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 17:22:44.345122 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-14b4a54c-e9aa-4159-9a54-63a8751ef50e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:22:44.345796 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-14b4a54c-e9aa-4159-9a54-63a8751ef50e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:22:44.348630 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 616/1245] 10.222.0.136 () {58 vars in 1237 bytes} [Thu Jul 14 17:22:44 2022] DELETE /identity/v3/projects/3ea1361195c1413a880c938483d78615 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:22:44.352870 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec41ee5-5cbc-45e4-a91c-7b343fefa3d4 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:22:44.354372 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-6ec41ee5-5cbc-45e4-a91c-7b343fefa3d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:22:44.367385 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec41ee5-5cbc-45e4-a91c-7b343fefa3d4 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:22:44.382975 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:22:44.430844 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00dcb84-549a-4200-80c4-a9788df27c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '602fa21468b24207a8f98e92cd2c99ce', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:22:44.431732 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00dcb84-549a-4200-80c4-a9788df27c6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:22:44.432021 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00dcb84-549a-4200-80c4-a9788df27c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:22:44.432303 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00dcb84-549a-4200-80c4-a9788df27c6e admin admin] PATH_INFO: `/v3/users/cb7e30c5b64247c79a373b66c79f343d` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:22:44.433486 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00dcb84-549a-4200-80c4-a9788df27c6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb7e30c5b64247c79a373b66c79f343d)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:22:44.435461 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00dcb84-549a-4200-80c4-a9788df27c6e admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:22:44.481624 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-e00dcb84-549a-4200-80c4-a9788df27c6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb7e30c5b64247c79a373b66c79f343d'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:22:44.488436 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-e00dcb84-549a-4200-80c4-a9788df27c6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb7e30c5b64247c79a373b66c79f343d'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:22:44.499931 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-e00dcb84-549a-4200-80c4-a9788df27c6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb7e30c5b64247c79a373b66c79f343d'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:22:44.500593 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-e00dcb84-549a-4200-80c4-a9788df27c6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb7e30c5b64247c79a373b66c79f343d'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:22:44.501211 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-e00dcb84-549a-4200-80c4-a9788df27c6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb7e30c5b64247c79a373b66c79f343d'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:22:44.512834 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 630/1246] 10.222.0.136 () {58 vars in 1228 bytes} [Thu Jul 14 17:22:44 2022] DELETE /identity/v3/users/cb7e30c5b64247c79a373b66c79f343d => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:22:44.696644 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b4a54c-e9aa-4159-9a54-63a8751ef50e admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:22:44.698120 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-14b4a54c-e9aa-4159-9a54-63a8751ef50e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:22:44.711150 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b4a54c-e9aa-4159-9a54-63a8751ef50e admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:22:44.786220 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935634be-cbf5-415d-802c-35314cff87d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '602fa21468b24207a8f98e92cd2c99ce', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:22:44.787112 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935634be-cbf5-415d-802c-35314cff87d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:22:44.787403 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935634be-cbf5-415d-802c-35314cff87d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:22:44.787687 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935634be-cbf5-415d-802c-35314cff87d1 admin admin] PATH_INFO: `/v3/projects/3db704d8162849e69dd833963a006a2a` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:22:44.788902 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935634be-cbf5-415d-802c-35314cff87d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3db704d8162849e69dd833963a006a2a)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:22:44.790863 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935634be-cbf5-415d-802c-35314cff87d1 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:22:44.812077 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:22:44.839298 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-935634be-cbf5-415d-802c-35314cff87d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3db704d8162849e69dd833963a006a2a', 'request_id': 'req-935634be-cbf5-415d-802c-35314cff87d1'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:22:44.845117 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-935634be-cbf5-415d-802c-35314cff87d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3db704d8162849e69dd833963a006a2a', 'request_id': 'req-935634be-cbf5-415d-802c-35314cff87d1'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:22:44.853390 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-935634be-cbf5-415d-802c-35314cff87d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3db704d8162849e69dd833963a006a2a', 'request_id': 'req-935634be-cbf5-415d-802c-35314cff87d1'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:22:44.865658 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-935634be-cbf5-415d-802c-35314cff87d1 admin admin] The token cache is being invalidate because project 3db704d8162849e69dd833963a006a2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98474) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 17:22:44.865952 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-935634be-cbf5-415d-802c-35314cff87d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:22:44.866594 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-935634be-cbf5-415d-802c-35314cff87d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:22:44.868133 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 617/1247] 10.222.0.136 () {58 vars in 1237 bytes} [Thu Jul 14 17:22:44 2022] DELETE /identity/v3/projects/3db704d8162849e69dd833963a006a2a => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:22:54.509561 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=45,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:22:54.861764 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=16,keystone:DELETE=7,keystone:INSERT=1 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:23:12.911571 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9b0a93-7bcc-4822-925c-9f3b908d5854 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:23:12.912054 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9b0a93-7bcc-4822-925c-9f3b908d5854 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:23:12.912148 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9b0a93-7bcc-4822-925c-9f3b908d5854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:23:12.930566 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-9b9b0a93-7bcc-4822-925c-9f3b908d5854 None None] MFA Rules not processed for user `6129f495e1214cc9b7cb922096858c34`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:23:12.931774 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-9b9b0a93-7bcc-4822-925c-9f3b908d5854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:23:12.985988 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 631/1248] 10.222.0.136 () {58 vars in 962 bytes} [Thu Jul 14 17:23:12 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:23:13.316252 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935634be-cbf5-415d-802c-35314cff87d1 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:23:13.317749 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-935634be-cbf5-415d-802c-35314cff87d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:23:13.376677 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935634be-cbf5-415d-802c-35314cff87d1 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:23:13.382912 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd840ab7-1049-476c-b0fa-974684a9ab45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8c6871e11f047e284afdb16bcb1d3a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd57eaa6dbca24cbb99dce1fe3437ecae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:23:13.383539 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd840ab7-1049-476c-b0fa-974684a9ab45 service neutron] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:23:13.383953 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd840ab7-1049-476c-b0fa-974684a9ab45 service neutron] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:23:13.384241 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd840ab7-1049-476c-b0fa-974684a9ab45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:23:13.387408 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-fd840ab7-1049-476c-b0fa-974684a9ab45 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:23:13.398276 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd840ab7-1049-476c-b0fa-974684a9ab45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:23:13.399719 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd840ab7-1049-476c-b0fa-974684a9ab45 service neutron] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:23:13.407669 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 618/1249] 10.222.0.136 () {60 vars in 1370 bytes} [Thu Jul 14 17:23:13 2022] GET /identity/v3/auth/tokens => generated 2679 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:23:14.066480 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9b0a93-7bcc-4822-925c-9f3b908d5854 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:23:14.068555 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-9b9b0a93-7bcc-4822-925c-9f3b908d5854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:23:14.142431 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9b0a93-7bcc-4822-925c-9f3b908d5854 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:23:14.148017 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8976975d-28d6-455e-95cd-b50df050fa20 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05cdf81bd7d14730962816677457e858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd57eaa6dbca24cbb99dce1fe3437ecae', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:23:14.148683 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8976975d-28d6-455e-95cd-b50df050fa20 service placement] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:23:14.148976 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8976975d-28d6-455e-95cd-b50df050fa20 service placement] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:23:14.149262 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8976975d-28d6-455e-95cd-b50df050fa20 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:23:14.153261 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-8976975d-28d6-455e-95cd-b50df050fa20 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:23:14.167908 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8976975d-28d6-455e-95cd-b50df050fa20 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:23:14.169587 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8976975d-28d6-455e-95cd-b50df050fa20 service placement] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:23:14.181322 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 632/1250] 10.222.0.136 () {60 vars in 1370 bytes} [Thu Jul 14 17:23:14 2022] GET /identity/v3/auth/tokens => generated 2866 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:23:22.987388 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd840ab7-1049-476c-b0fa-974684a9ab45 service neutron] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:23:22.988885 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-fd840ab7-1049-476c-b0fa-974684a9ab45 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:23:23.073999 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd840ab7-1049-476c-b0fa-974684a9ab45 service neutron] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:23:23.079042 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17e53b9-c25b-42f5-816c-126d3e33dd25 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc2b7d015c2046ddacac6e682f22d0f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd57eaa6dbca24cbb99dce1fe3437ecae', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:23:23.079700 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17e53b9-c25b-42f5-816c-126d3e33dd25 service nova] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:23:23.079993 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17e53b9-c25b-42f5-816c-126d3e33dd25 service nova] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:23:23.080279 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17e53b9-c25b-42f5-816c-126d3e33dd25 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:23:23.082166 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-c17e53b9-c25b-42f5-816c-126d3e33dd25 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:23:23.094264 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17e53b9-c25b-42f5-816c-126d3e33dd25 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:23:23.095846 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17e53b9-c25b-42f5-816c-126d3e33dd25 service nova] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:23:23.106854 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 619/1251] 10.222.0.136 () {60 vars in 1370 bytes} [Thu Jul 14 17:23:22 2022] GET /identity/v3/auth/tokens => generated 2861 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:23:24.175704 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=57 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:23:26.644723 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8976975d-28d6-455e-95cd-b50df050fa20 service placement] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:23:26.657208 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8976975d-28d6-455e-95cd-b50df050fa20 service placement] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:23:26.662249 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969b0943-f127-4770-bcb6-b4ebc6c08560 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc2b7d015c2046ddacac6e682f22d0f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd57eaa6dbca24cbb99dce1fe3437ecae', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:23:26.662933 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969b0943-f127-4770-bcb6-b4ebc6c08560 service nova] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:23:26.663217 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969b0943-f127-4770-bcb6-b4ebc6c08560 service nova] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:23:26.663496 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969b0943-f127-4770-bcb6-b4ebc6c08560 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:23:26.665372 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-969b0943-f127-4770-bcb6-b4ebc6c08560 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:23:26.677809 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969b0943-f127-4770-bcb6-b4ebc6c08560 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:23:26.679494 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969b0943-f127-4770-bcb6-b4ebc6c08560 service nova] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:23:26.690105 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 633/1252] 10.222.0.136 () {60 vars in 1370 bytes} [Thu Jul 14 17:23:26 2022] GET /identity/v3/auth/tokens => generated 2861 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:23:33.102868 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=58 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:23:36.685795 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=6 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:25:27.933522 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17e53b9-c25b-42f5-816c-126d3e33dd25 service nova] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:25:27.935047 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-c17e53b9-c25b-42f5-816c-126d3e33dd25 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:25:28.001913 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17e53b9-c25b-42f5-816c-126d3e33dd25 service nova] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:25:28.007068 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aed6531-9179-4fb6-9048-9c98864dbb4a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05cdf81bd7d14730962816677457e858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd57eaa6dbca24cbb99dce1fe3437ecae', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:25:28.007760 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aed6531-9179-4fb6-9048-9c98864dbb4a service placement] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:25:28.008053 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aed6531-9179-4fb6-9048-9c98864dbb4a service placement] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:25:28.008339 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aed6531-9179-4fb6-9048-9c98864dbb4a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:25:28.010159 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-2aed6531-9179-4fb6-9048-9c98864dbb4a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:25:28.022452 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aed6531-9179-4fb6-9048-9c98864dbb4a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:25:28.024048 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aed6531-9179-4fb6-9048-9c98864dbb4a service placement] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:25:28.034775 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 620/1253] 10.222.0.136 () {60 vars in 1370 bytes} [Thu Jul 14 17:25:27 2022] GET /identity/v3/auth/tokens => generated 2866 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:25:38.029801 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=28 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:25:57.785817 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969b0943-f127-4770-bcb6-b4ebc6c08560 service nova] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:25:57.805834 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969b0943-f127-4770-bcb6-b4ebc6c08560 service nova] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:25:57.809754 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4469d60-63d3-4141-85a9-1e077400376f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8c6871e11f047e284afdb16bcb1d3a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd57eaa6dbca24cbb99dce1fe3437ecae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:25:57.810429 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4469d60-63d3-4141-85a9-1e077400376f service neutron] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:25:57.810717 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4469d60-63d3-4141-85a9-1e077400376f service neutron] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:25:57.810998 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4469d60-63d3-4141-85a9-1e077400376f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:25:57.812745 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-b4469d60-63d3-4141-85a9-1e077400376f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:25:57.899428 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4469d60-63d3-4141-85a9-1e077400376f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:25:57.900892 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4469d60-63d3-4141-85a9-1e077400376f service neutron] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:25:57.911187 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 634/1254] 10.222.0.136 () {60 vars in 1370 bytes} [Thu Jul 14 17:25:57 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:26:03.826500 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aed6531-9179-4fb6-9048-9c98864dbb4a service placement] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:26:03.827998 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-2aed6531-9179-4fb6-9048-9c98864dbb4a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:26:03.841852 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aed6531-9179-4fb6-9048-9c98864dbb4a service placement] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:26:03.846376 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb5af3e-fb41-4783-81b8-5fad351eb696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '602fa21468b24207a8f98e92cd2c99ce', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:26:03.847252 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb5af3e-fb41-4783-81b8-5fad351eb696 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:26:03.847564 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb5af3e-fb41-4783-81b8-5fad351eb696 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:26:03.847852 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb5af3e-fb41-4783-81b8-5fad351eb696 admin admin] PATH_INFO: `/v3/users/6129f495e1214cc9b7cb922096858c34` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:26:03.849056 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb5af3e-fb41-4783-81b8-5fad351eb696 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6129f495e1214cc9b7cb922096858c34)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:26:03.851608 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb5af3e-fb41-4783-81b8-5fad351eb696 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:26:03.905654 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-bdb5af3e-fb41-4783-81b8-5fad351eb696 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6129f495e1214cc9b7cb922096858c34'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:26:03.913864 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-bdb5af3e-fb41-4783-81b8-5fad351eb696 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6129f495e1214cc9b7cb922096858c34'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:26:03.914687 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-bdb5af3e-fb41-4783-81b8-5fad351eb696 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6129f495e1214cc9b7cb922096858c34'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:26:03.923342 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-bdb5af3e-fb41-4783-81b8-5fad351eb696 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6129f495e1214cc9b7cb922096858c34'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:26:03.936199 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-bdb5af3e-fb41-4783-81b8-5fad351eb696 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6129f495e1214cc9b7cb922096858c34'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:26:03.942815 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 621/1255] 10.222.0.136 () {58 vars in 1228 bytes} [Thu Jul 14 17:26:03 2022] DELETE /identity/v3/users/6129f495e1214cc9b7cb922096858c34 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:26:04.121930 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4469d60-63d3-4141-85a9-1e077400376f service neutron] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:26:04.132597 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4469d60-63d3-4141-85a9-1e077400376f service neutron] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:26:04.194711 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95afe5ab-c92c-4133-b96c-2972c84ff3ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '602fa21468b24207a8f98e92cd2c99ce', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:26:04.195841 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95afe5ab-c92c-4133-b96c-2972c84ff3ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:26:04.196136 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95afe5ab-c92c-4133-b96c-2972c84ff3ad admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:26:04.196420 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95afe5ab-c92c-4133-b96c-2972c84ff3ad admin admin] PATH_INFO: `/v3/projects/d6ab0f5b6d5b4041903e867a33cb7a5c` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:26:04.197692 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95afe5ab-c92c-4133-b96c-2972c84ff3ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6ab0f5b6d5b4041903e867a33cb7a5c)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:26:04.200037 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95afe5ab-c92c-4133-b96c-2972c84ff3ad admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:26:04.248880 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-95afe5ab-c92c-4133-b96c-2972c84ff3ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6ab0f5b6d5b4041903e867a33cb7a5c', 'request_id': 'req-95afe5ab-c92c-4133-b96c-2972c84ff3ad'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:26:04.256713 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-95afe5ab-c92c-4133-b96c-2972c84ff3ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6ab0f5b6d5b4041903e867a33cb7a5c', 'request_id': 'req-95afe5ab-c92c-4133-b96c-2972c84ff3ad'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:26:04.263453 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-95afe5ab-c92c-4133-b96c-2972c84ff3ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6ab0f5b6d5b4041903e867a33cb7a5c', 'request_id': 'req-95afe5ab-c92c-4133-b96c-2972c84ff3ad'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:26:04.267341 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:26:04.276687 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-95afe5ab-c92c-4133-b96c-2972c84ff3ad admin admin] The token cache is being invalidate because project d6ab0f5b6d5b4041903e867a33cb7a5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 17:26:04.278137 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-95afe5ab-c92c-4133-b96c-2972c84ff3ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:26:04.278949 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-95afe5ab-c92c-4133-b96c-2972c84ff3ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:26:04.280502 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 635/1256] 10.222.0.136 () {58 vars in 1237 bytes} [Thu Jul 14 17:26:04 2022] DELETE /identity/v3/projects/d6ab0f5b6d5b4041903e867a33cb7a5c => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:26:04.284652 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb5af3e-fb41-4783-81b8-5fad351eb696 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:26:04.286087 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-bdb5af3e-fb41-4783-81b8-5fad351eb696 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:26:04.299644 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb5af3e-fb41-4783-81b8-5fad351eb696 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:26:04.357342 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa61c0f4-8280-4ddb-a2ab-c287bf0f14d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '602fa21468b24207a8f98e92cd2c99ce', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:26:04.358255 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa61c0f4-8280-4ddb-a2ab-c287bf0f14d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:26:04.358540 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa61c0f4-8280-4ddb-a2ab-c287bf0f14d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:26:04.358817 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa61c0f4-8280-4ddb-a2ab-c287bf0f14d2 admin admin] PATH_INFO: `/v3/users/4fb471ce708f45a7ad6cf36902ff6cf1` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:26:04.359994 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa61c0f4-8280-4ddb-a2ab-c287bf0f14d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4fb471ce708f45a7ad6cf36902ff6cf1)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:26:04.361956 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa61c0f4-8280-4ddb-a2ab-c287bf0f14d2 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:26:04.408348 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-aa61c0f4-8280-4ddb-a2ab-c287bf0f14d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4fb471ce708f45a7ad6cf36902ff6cf1'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:26:04.415876 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-aa61c0f4-8280-4ddb-a2ab-c287bf0f14d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4fb471ce708f45a7ad6cf36902ff6cf1'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:26:04.416502 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-aa61c0f4-8280-4ddb-a2ab-c287bf0f14d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4fb471ce708f45a7ad6cf36902ff6cf1'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:26:04.424088 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-aa61c0f4-8280-4ddb-a2ab-c287bf0f14d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4fb471ce708f45a7ad6cf36902ff6cf1'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:26:04.431628 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:26:04.437746 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-aa61c0f4-8280-4ddb-a2ab-c287bf0f14d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4fb471ce708f45a7ad6cf36902ff6cf1'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:26:04.444712 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 622/1257] 10.222.0.136 () {58 vars in 1228 bytes} [Thu Jul 14 17:26:04 2022] DELETE /identity/v3/users/4fb471ce708f45a7ad6cf36902ff6cf1 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:26:04.621951 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95afe5ab-c92c-4133-b96c-2972c84ff3ad admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:26:04.623534 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-95afe5ab-c92c-4133-b96c-2972c84ff3ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:26:04.638720 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95afe5ab-c92c-4133-b96c-2972c84ff3ad admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:26:04.696775 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb31f2e-e404-49f7-bef1-31a4a57b630b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2178b080bea24cb2a1f6b50c1554ccd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '602fa21468b24207a8f98e92cd2c99ce', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:26:04.697574 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb31f2e-e404-49f7-bef1-31a4a57b630b admin admin] REQUEST_METHOD: `DELETE` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:26:04.698310 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb31f2e-e404-49f7-bef1-31a4a57b630b admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:26:04.698616 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb31f2e-e404-49f7-bef1-31a4a57b630b admin admin] PATH_INFO: `/v3/projects/a5ec99bbe4b84e9d8775bc073d4c6b41` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:26:04.700034 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb31f2e-e404-49f7-bef1-31a4a57b630b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5ec99bbe4b84e9d8775bc073d4c6b41)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:26:04.701971 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb31f2e-e404-49f7-bef1-31a4a57b630b admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:26:04.758008 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-ffb31f2e-e404-49f7-bef1-31a4a57b630b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5ec99bbe4b84e9d8775bc073d4c6b41', 'request_id': 'req-ffb31f2e-e404-49f7-bef1-31a4a57b630b'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:26:04.765953 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-ffb31f2e-e404-49f7-bef1-31a4a57b630b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5ec99bbe4b84e9d8775bc073d4c6b41', 'request_id': 'req-ffb31f2e-e404-49f7-bef1-31a4a57b630b'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:26:04.772312 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-ffb31f2e-e404-49f7-bef1-31a4a57b630b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5ec99bbe4b84e9d8775bc073d4c6b41', 'request_id': 'req-ffb31f2e-e404-49f7-bef1-31a4a57b630b'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:26:04.787801 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-ffb31f2e-e404-49f7-bef1-31a4a57b630b admin admin] The token cache is being invalidate because project a5ec99bbe4b84e9d8775bc073d4c6b41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 17:26:04.788096 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-ffb31f2e-e404-49f7-bef1-31a4a57b630b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:26:04.788874 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-ffb31f2e-e404-49f7-bef1-31a4a57b630b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:26:04.791138 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 636/1258] 10.222.0.136 () {58 vars in 1237 bytes} [Thu Jul 14 17:26:04 2022] DELETE /identity/v3/projects/a5ec99bbe4b84e9d8775bc073d4c6b41 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:26:14.444008 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=3,keystone:DELETE=1 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:26:14.784681 dv-osbrick-849858-2-ceph devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:DELETE=8,keystone:SELECT=53,keystone:INSERT=1 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:30:28.886904 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa61c0f4-8280-4ddb-a2ab-c287bf0f14d2 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:30:28.888404 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-aa61c0f4-8280-4ddb-a2ab-c287bf0f14d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:30:28.976419 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa61c0f4-8280-4ddb-a2ab-c287bf0f14d2 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:30:29.046941 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab1b9e3-742b-4505-98c1-9de5b04d94f1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05cdf81bd7d14730962816677457e858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd57eaa6dbca24cbb99dce1fe3437ecae', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:30:29.047604 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab1b9e3-742b-4505-98c1-9de5b04d94f1 service placement] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:30:29.047900 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab1b9e3-742b-4505-98c1-9de5b04d94f1 service placement] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:30:29.048184 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab1b9e3-742b-4505-98c1-9de5b04d94f1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:30:29.050578 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-6ab1b9e3-742b-4505-98c1-9de5b04d94f1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:30:29.063429 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab1b9e3-742b-4505-98c1-9de5b04d94f1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:30:29.065068 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab1b9e3-742b-4505-98c1-9de5b04d94f1 service placement] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:30:29.085099 dv-osbrick-849858-2-ceph devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 623/1259] 10.222.0.136 () {60 vars in 1370 bytes} [Thu Jul 14 17:30:28 2022] GET /identity/v3/auth/tokens => generated 2866 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)